-- Logs begin at Wed 2022-08-03 08:47:13 UTC, end at Wed 2022-08-03 10:14:40 UTC. -- Aug 03 09:21:38.430530 dv-cinder-844563-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 09:21:38.438669 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 09:21:38 2022] *** Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: nodename: dv-cinder-844563-5-iscsi Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: machine: x86_64 Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: clock source: unix Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: pcre jit disabled Aug 03 09:21:38.440693 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: detected number of CPU cores: 4 Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: current working directory: / Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: detected binary path: /usr/bin/uwsgi-core Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: your processes number limit is 47680 Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: your memory page size is 4096 bytes Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: detected max file descriptor number: 2048 Aug 03 09:21:38.441322 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: lock engine: pthread robust mutexes Aug 03 09:21:38.444156 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: thunder lock: enabled Aug 03 09:21:38.444156 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 09:21:38.444156 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 09:21:38.480613 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: Python main interpreter initialized at 0x555df4de59c0 Aug 03 09:21:38.480613 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: python threads support enabled Aug 03 09:21:38.480613 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: your server socket listen backlog is limited to 100 connections Aug 03 09:21:38.480613 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: your mercy for graceful operations on workers is 90 seconds Aug 03 09:21:38.481037 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 09:21:38.481037 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: *** Operational MODE: preforking *** Aug 03 09:21:38.481307 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: *** uWSGI is running in multiple interpreter mode *** Aug 03 09:21:38.481307 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: spawned uWSGI master process (pid: 103196) Aug 03 09:21:38.481499 dv-cinder-844563-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 09:21:38.486186 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: spawned uWSGI worker 1 (pid: 103197, cores: 1) Aug 03 09:21:38.486186 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: spawned uWSGI worker 2 (pid: 103198, cores: 1) Aug 03 09:21:38.486186 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 09:21:39.142378 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 09:21:39.164309 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 09:21:40.218508 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:21:40.218508 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Aug 03 09:21:40.219128 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:21:40.219128 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: from cryptography.utils import int_from_bytes Aug 03 09:21:40.223172 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:21:40.223172 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: from cryptography.utils import int_from_bytes Aug 03 09:21:40.223598 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:21:40.223598 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: from cryptography.utils import int_from_bytes Aug 03 09:21:42.718011 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 09:21:42.718596 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 09:21:42.718679 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 09:21:42.718679 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 09:21:42.719082 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 09:21:42.719082 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 09:21:42.719222 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 09:21:42.719341 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 09:21:42.719496 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 09:21:42.719718 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.719828 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 09:21:42.720029 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.720133 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.720346 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.720443 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.720656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.720748 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721005 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721113 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721311 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721412 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721620 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721716 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.721929 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722019 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722245 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722332 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722493 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722589 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722797 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.722886 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723115 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723217 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-5-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723420 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723520 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-5-iscsi {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723717 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.723808 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724019 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724116 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724338 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724442 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724618 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724726 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.724956 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.725054 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.725249 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.725346 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.725560 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.725733 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726060 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726170 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726369 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726459 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726669 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726759 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.726973 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727091 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727304 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727424 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727626 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727721 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.727916 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728020 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728213 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728308 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728521 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728608 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728843 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.728952 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729154 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729244 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-5-iscsi {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729519 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729608 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-5-iscsi {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729822 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.729910 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730127 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730234 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730431 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730525 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730823 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.730925 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731123 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731220 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731427 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731514 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731739 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.731828 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.732040 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.732129 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.732368 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.732475 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.732666 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.733325 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.733516 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.733616 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.733827 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.733919 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734123 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734222 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734423 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734521 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734724 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.734825 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735033 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735130 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735330 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735419 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735625 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735726 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735869 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.735957 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736154 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736558 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736769 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.736876 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737103 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737205 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737346 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737443 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737587 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737676 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737885 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.737986 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738284 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738495 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738584 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738796 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.738979 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739095 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739184 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739391 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739487 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739686 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739782 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.739983 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740071 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740277 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740370 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740575 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740672 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740894 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.740985 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741204 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741304 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741512 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741609 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741809 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.741904 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742118 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742213 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742435 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742532 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742730 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.742818 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743030 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743126 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743348 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743437 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743654 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743742 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.743955 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744045 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744266 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744355 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744574 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744669 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.744894 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745002 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745196 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745285 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745496 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745582 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745798 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.745899 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746112 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746208 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746406 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746495 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746647 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746761 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.746940 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747037 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747235 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747324 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747531 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747627 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747827 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.747915 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.748125 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.748214 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.748982 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749147 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749291 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749380 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749587 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749683 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749882 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.749971 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750178 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750269 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750475 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750564 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750774 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.750877 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751071 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751170 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751368 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751465 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751663 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751758 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.751959 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752047 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752259 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752354 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752567 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752663 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752886 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.752980 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753184 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753286 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753481 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753570 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753777 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.753866 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754165 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754372 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754461 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754668 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754756 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.754973 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755061 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755267 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755356 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755562 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755651 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755865 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.755967 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756161 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756256 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756457 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756546 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.756869 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757085 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757174 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757365 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757454 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757665 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757762 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.757960 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758055 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758258 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758347 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758553 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758651 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758849 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.758937 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759141 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759275 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759437 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759536 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759731 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.759820 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760024 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760121 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760314 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760411 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760609 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760701 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.760946 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761040 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761243 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761332 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761538 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761627 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761833 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.761922 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.762134 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.762223 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.762450 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:21:42.762540 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.762769 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.762857 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763095 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763184 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763397 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763494 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763720 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.763819 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.764083 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.764205 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.764407 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.764728 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.765061 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.765374 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.765603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.765701 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.765927 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766017 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766249 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766418 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766578 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766666 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766892 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.766992 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767205 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767293 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767515 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767608 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767832 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.767930 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768146 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768460 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768556 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768771 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.768914 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769106 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769196 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769422 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769511 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769732 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.769828 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770038 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770127 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770361 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770449 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770677 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770766 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.770983 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771073 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771307 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771402 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771625 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771714 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.771934 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772024 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772243 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772332 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772552 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772654 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772880 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.772982 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773190 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773287 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773495 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773592 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773812 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.773902 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774121 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774261 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774430 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774550 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774739 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.774838 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775044 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775166 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775347 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775460 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775652 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.775958 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776054 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776262 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776354 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776567 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.776908 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777002 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777218 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777316 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777615 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777830 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.777925 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778133 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778223 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778433 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778522 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778735 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.778822 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779034 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779124 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779333 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779460 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779686 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.779954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780058 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780141 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780367 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780465 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780690 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.780787 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781018 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781110 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781326 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781414 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781636 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781735 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.781947 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782037 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782251 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782338 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782557 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782659 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782862 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.782951 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783161 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783249 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783464 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783562 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783769 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.783871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784067 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784157 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784384 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784474 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784689 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.784786 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785015 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785328 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785456 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785625 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.785923 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786013 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786228 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786317 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786532 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786621 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786837 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.786932 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787143 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787240 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787448 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787537 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787767 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.787876 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788073 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788162 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788376 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788464 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788697 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.788896 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789041 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789130 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789341 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789438 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789641 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789742 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.789953 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790045 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790255 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790352 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790550 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790652 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790851 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.790947 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791144 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791240 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791440 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791530 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791738 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.791834 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792041 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792131 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792334 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792424 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792630 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792719 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.792947 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793050 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793245 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793336 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793542 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793631 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793840 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.793929 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794145 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794288 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794437 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794527 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794733 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.794832 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.795030 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.795127 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.795900 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.795998 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.796204 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.796300 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.796541 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.796630 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.796870 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797009 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797189 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797288 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797500 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797590 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797800 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.797887 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798106 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798203 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798426 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798520 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798711 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.798806 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799014 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799104 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799314 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799491 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799621 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799699 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.799919 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800009 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800230 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800373 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800533 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800635 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800847 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.800938 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801161 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801248 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801473 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801575 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801770 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.801871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802076 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802174 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802415 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802504 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802725 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.802815 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803032 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803121 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803338 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803438 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803638 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803726 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.803943 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804243 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804383 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804546 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804637 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804867 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.804972 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805172 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805271 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805479 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805567 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805780 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.805905 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806088 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806192 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806389 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806478 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806689 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806778 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.806989 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807113 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807296 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807385 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807591 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807684 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807895 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.807985 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808213 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808300 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808528 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808616 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808846 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.808937 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.809404 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.809501 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.809713 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.809800 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810013 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810109 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810313 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810454 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810613 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.810771 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.811453 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.811551 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.811755 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.811991 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812084 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812176 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812356 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812455 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812657 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.812983 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813090 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813281 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813370 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813589 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813678 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813892 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.813990 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814188 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814278 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814482 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814571 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814785 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.814883 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815098 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815188 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815399 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815495 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815712 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.815801 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816023 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816111 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816320 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816422 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816616 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816706 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.816940 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817045 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817333 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817538 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817626 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817834 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.817923 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818129 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818217 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818461 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818553 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818763 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.818851 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819059 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819160 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819370 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819465 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819677 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819764 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.819980 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820286 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820376 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820589 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820678 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.820912 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821016 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821229 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821318 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821532 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821621 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821833 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.821935 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822138 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822227 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822445 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822536 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822746 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.822837 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823047 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823136 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823359 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823449 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823661 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823753 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.823958 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824045 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824259 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824349 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824556 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824851 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.824944 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.825174 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.825261 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.825488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.825724 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.825823 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826044 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826134 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826351 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826493 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826728 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.826925 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827184 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827348 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827522 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827670 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827829 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.827989 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828138 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828311 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828446 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828609 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828751 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.828935 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829090 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829233 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829398 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829528 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829704 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.829831 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830009 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830127 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830321 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830410 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830627 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830718 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.830929 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831033 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831229 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831327 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831533 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831631 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831835 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.831931 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832135 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832223 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832434 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832585 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832730 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.832863 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833057 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833160 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833354 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833443 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833662 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833750 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.833963 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834067 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834259 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834348 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834554 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834695 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834849 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.834949 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835183 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835279 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835479 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835569 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835807 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.835913 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836127 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836260 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836429 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836526 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836747 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.836855 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837071 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837166 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837372 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837461 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837673 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837762 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.837968 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838070 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838265 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838363 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838568 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838660 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838867 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.838958 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839161 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839259 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839462 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839551 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839762 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.839850 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840059 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840155 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840357 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840452 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840651 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840740 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.840974 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841084 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841268 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841360 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841567 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841654 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.841863 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842025 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842194 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842334 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842496 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842647 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842817 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.842916 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843066 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843156 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843360 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843449 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843662 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.843956 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844046 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844254 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844343 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844546 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844642 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844859 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.844955 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845154 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845455 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845554 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845755 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.845845 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846049 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846153 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846350 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846439 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846650 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846738 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.846946 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847044 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847242 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847331 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847540 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847628 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847832 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.847929 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848128 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848217 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848517 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848737 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.848850 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849069 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849159 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849360 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849448 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849660 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849758 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.849950 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850046 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850247 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850341 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850542 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850640 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850839 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.850931 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851130 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851217 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851424 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851514 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851714 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.851803 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852012 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852101 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852305 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852396 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852607 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852703 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.852931 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853070 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853231 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853332 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853529 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853618 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.853823 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.854155 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.854448 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.854801 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.854906 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855096 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855187 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855402 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855493 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855708 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.855798 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856011 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856100 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856312 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856449 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856616 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856705 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.856934 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.857025 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.857240 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.857331 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.857542 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858186 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858384 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858557 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858727 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858854 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.858941 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859076 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859250 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859382 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859551 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859704 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.859853 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860016 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860168 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860314 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860482 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860634 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860797 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.860981 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861116 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861307 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861420 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861613 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861723 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.861922 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862021 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862232 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862322 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862542 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862641 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862852 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.862951 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863161 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863252 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863469 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863565 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863772 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.863870 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864073 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864162 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864370 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864460 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864672 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864772 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.864996 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865089 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865292 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865381 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865599 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865689 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865899 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.865987 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866197 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866286 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866500 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866604 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866796 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.866886 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867095 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867184 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867390 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867480 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867696 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867792 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.867999 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.868088 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.868389 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.868477 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.868685 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.868776 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869013 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869117 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869315 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869403 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869620 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869709 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.869921 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870017 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870217 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870306 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870527 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870623 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870831 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.870999 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871202 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871291 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871504 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871593 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871801 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.871900 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872097 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872186 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872401 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872491 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872705 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.872795 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.873028 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.873117 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.873353 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.873467 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.874207 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.874325 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.874637 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.874725 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.874948 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875095 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875275 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875365 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875578 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875667 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875901 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.875991 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.876259 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.876359 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.876616 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.876705 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.876949 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877058 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877280 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877377 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877597 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877687 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.877912 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878010 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878228 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878317 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878525 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878615 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878831 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.878953 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879136 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879240 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879452 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879542 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879769 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.879846 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880068 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880166 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880375 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880514 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880669 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.880758 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881007 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881112 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881310 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881399 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881611 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881707 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.881923 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882015 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882234 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882323 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882556 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882646 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.882916 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883006 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883228 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883319 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883542 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883632 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883838 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.883936 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884133 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884222 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884434 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884525 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884729 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.884839 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885047 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885177 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885360 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885465 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.885957 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886055 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886258 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886354 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886556 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886645 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886851 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.886942 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887145 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887253 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887449 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887538 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887741 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.887829 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888054 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888153 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888352 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888440 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888662 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.888751 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889018 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889112 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889343 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889619 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889709 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.889948 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890047 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890256 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890346 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890556 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890854 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.890951 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891153 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891451 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891540 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891772 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.891873 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892074 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892169 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892391 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892480 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892714 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.892805 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893044 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893134 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893355 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893443 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893674 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893765 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.893984 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894074 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894294 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894381 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894607 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894744 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894903 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.894993 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895200 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895289 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895504 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895798 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.895894 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896093 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896192 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896389 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896479 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896688 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.896776 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897019 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897129 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897312 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897409 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897607 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897696 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897903 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.897999 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898202 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898289 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898507 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898595 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898807 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.898904 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899193 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899400 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899491 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899697 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899787 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.899994 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900083 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900310 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900470 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900616 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900707 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.900959 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901066 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901272 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901361 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901587 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901676 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901892 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.901982 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902201 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902290 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902511 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902607 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902818 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.902908 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903127 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903226 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903434 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903737 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.903824 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904041 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904140 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904345 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904434 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904675 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.904774 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905010 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905114 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905314 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905404 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905623 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905712 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.905939 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.906134 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.906455 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.906553 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.906762 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.906853 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907070 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907164 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907376 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907467 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907682 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907779 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.907988 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908079 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908292 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908381 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908597 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908695 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.908928 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909022 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909233 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909322 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909543 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909645 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909854 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.909944 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910172 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910261 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910496 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910661 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910801 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.910879 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911240 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911410 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911516 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911715 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.911807 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912026 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912114 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912355 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912453 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912678 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912770 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.912990 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913097 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913297 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913387 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913601 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913698 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.913902 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914001 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914205 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914296 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914508 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914596 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914808 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.914906 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915113 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915203 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915414 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915503 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915718 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.915820 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916018 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916324 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916412 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916736 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.916978 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917118 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917284 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917374 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917587 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917686 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917893 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.917983 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.918204 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.918403 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.918710 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.918800 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919021 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919110 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919338 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919435 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919654 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919751 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.919960 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.920051 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.920782 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.920951 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921118 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921216 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921416 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921504 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921715 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.921814 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922020 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922111 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922323 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922422 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922628 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922726 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.922933 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923021 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923233 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923322 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923529 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923620 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923837 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.923925 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.924136 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.924224 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.924450 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.924662 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925007 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925101 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925327 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925428 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925650 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925740 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.925970 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926058 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926279 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926378 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926579 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926669 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926886 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.926974 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927183 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927280 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927482 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927573 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927787 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.927875 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928086 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928187 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928383 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928473 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928679 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.928769 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929002 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929312 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929401 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929610 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929701 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.929910 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930007 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930204 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930292 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930506 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930596 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930806 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.930940 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931207 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931401 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931499 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931700 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931790 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.931994 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932082 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932293 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932383 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932589 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932679 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932906 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.932999 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933208 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933297 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933501 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933598 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933801 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.933890 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.934094 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.934446 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.934652 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.934742 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.934947 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935036 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935341 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935556 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935646 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.935930 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936021 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936231 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936386 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936526 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936616 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936848 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.936938 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937154 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937256 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937465 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937562 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937766 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.937856 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938067 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938158 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938371 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938508 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938697 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.938786 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939008 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939218 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939538 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939627 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939846 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.939935 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940169 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940261 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940490 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940580 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940788 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.940947 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941095 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941183 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941392 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941707 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.941806 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942011 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942110 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942319 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942408 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942621 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942720 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.942927 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943016 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943224 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943321 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943526 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943629 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943826 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.943916 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944129 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944220 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944430 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944528 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944729 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.944839 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945055 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945144 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945354 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945445 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945655 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945745 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.945955 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946054 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946258 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946355 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946571 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946661 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946880 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.946977 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947185 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947276 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947492 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947589 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947799 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.947898 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948100 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948191 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948399 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948489 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948702 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.948800 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949024 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949114 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949330 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949430 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949643 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949742 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.949946 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950043 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950243 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950342 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950555 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950645 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.950942 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.951038 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.951255 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.951345 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952080 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952193 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952387 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952633 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952733 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.952993 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953087 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953319 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953409 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953631 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953719 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.953933 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954033 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954250 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954347 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954561 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954651 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954881 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.954971 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955198 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955295 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955497 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955588 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955796 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.955887 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956093 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956191 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956395 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956495 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956704 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.956795 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957028 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957119 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957324 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957427 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957620 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957713 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.957920 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958009 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958213 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958315 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958508 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958604 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958804 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.958900 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959097 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959193 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959395 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959492 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959688 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959776 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.959981 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960072 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960275 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960373 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960569 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960660 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960885 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.960989 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961179 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961267 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961479 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961570 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961774 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.961871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962069 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962159 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962362 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962466 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962660 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962748 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.962954 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963042 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963251 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963350 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963553 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963643 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963879 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.963967 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964194 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964298 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964497 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964587 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964854 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.964958 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965133 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965237 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965447 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965537 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965752 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.965840 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966058 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966148 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966360 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966458 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966680 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966768 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.966980 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.967119 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.967425 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.967569 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.967800 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.967897 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968166 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968264 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968426 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968526 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968730 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.968839 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969073 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969166 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969390 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969479 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969686 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.969783 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970003 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970093 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970313 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970405 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970625 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970724 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.970935 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971025 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971238 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971378 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971551 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971653 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971849 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.971938 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972150 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972239 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972450 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972549 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972756 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.972866 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973088 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973178 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973392 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973482 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973696 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.973786 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974000 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974137 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974305 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974396 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974610 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974702 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.974921 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975019 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975235 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975325 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975536 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975626 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975854 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.975953 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976158 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976255 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976487 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976577 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976788 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.976913 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977144 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977242 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977548 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977763 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.977853 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978069 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978166 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978367 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978457 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 09:21:42.978694 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.978998 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:21:42.979239 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 09:21:43.134597 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO dbcounter [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Registered counter for database nova_api Aug 03 09:21:43.140482 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Registered counter for database nova_api Aug 03 09:21:43.156715 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_db.sqlalchemy.engines [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.160466 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.163257 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writer thread running {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.167015 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.218760 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.context [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dd4996a-81ed-45f2-a688-0b41f856dafc(cell1) {{(pid=103197) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 09:21:43.222646 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.context [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dd4996a-81ed-45f2-a688-0b41f856dafc(cell1) {{(pid=103198) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 09:21:43.222763 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:21:43.224213 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:21:43.225024 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:21:43.226592 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:21:43.226993 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:21:43.228168 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:21:43.228984 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO dbcounter [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Registered counter for database nova_cell0 Aug 03 09:21:43.229078 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:21:43.230969 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_concurrency.lockutils [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103198) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:21:43.233598 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Registered counter for database nova_cell0 Aug 03 09:21:43.234945 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO dbcounter [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Registered counter for database nova_cell1 Aug 03 09:21:43.239289 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Registered counter for database nova_cell1 Aug 03 09:21:43.242779 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_db.sqlalchemy.engines [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.244570 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_db.sqlalchemy.engines [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.245960 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.249410 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.250210 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writer thread running {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.252776 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.255391 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writer thread running {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.391575 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.395321 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO dbcounter [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Registered counter for database nova_cell0 Aug 03 09:21:43.400906 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO dbcounter [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Registered counter for database nova_cell0 Aug 03 09:21:43.402364 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_db.sqlalchemy.engines [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.407456 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writer thread running {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.410372 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG oslo_db.sqlalchemy.engines [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:21:43.415050 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writer thread running {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:21:43.741367 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: WARNING keystonemiddleware.auth_token [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:21:43.747380 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:21:43.749163 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: WARNING keystonemiddleware.auth_token [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:21:43.755210 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:21:44.088523 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: WARNING keystonemiddleware.auth_token [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:21:44.094545 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: WARNING keystonemiddleware.auth_token [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:21:44.095505 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:21:44.099792 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555df4de59c0 pid: 103197 (default app) Aug 03 09:21:44.101502 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: WARNING keystonemiddleware.auth_token [None req-8864c053-d6db-42e2-926f-5407f2cc044a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:21:44.101864 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:21:44.103035 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 03 09:21:44.103444 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Wed Aug 3 09:21:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:21:44.106762 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555df4de59c0 pid: 103198 (default app) Aug 03 09:22:59.539932 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:22:59.540973 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 03 09:22:59.541385 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:22:59.554038 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:22:59.554909 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:22:59.555999 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell1:SELECT=3 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:22:59.557374 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:00.410197 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e6d161b7-47a6-4fee-966d-efe269ecb9b1 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:00.443398 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-e6d161b7-47a6-4fee-966d-efe269ecb9b1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895041 Aug 03 09:23:00.444219 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Aug 3 09:22:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:23:02.666811 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:02.667812 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-b28acfc7-d341-414b-9ad3-47389d3c9ad5 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 03 09:23:02.668363 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:03.125985 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-fe00c498-b564-4a92-bec8-95c2893c8b17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:03.147135 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:23:03.147135 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Aug 03 09:23:03.175275 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-fe00c498-b564-4a92-bec8-95c2893c8b17 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499328 Aug 03 09:23:03.175944 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:03.189051 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_api:SELECT=3 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:03.190989 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_cell0:SELECT=3 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:03.192296 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_cell1:SELECT=3 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:03.193171 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:03.397428 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-90697cee-dde5-4c41-90f9-61c2a8a5310b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:03.401831 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:23:03.401831 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:23:03.466952 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-90697cee-dde5-4c41-90f9-61c2a8a5310b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283058 Aug 03 09:23:03.467783 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Aug 3 09:23:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:05.764425 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-fe00c498-b564-4a92-bec8-95c2893c8b17 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:05.765487 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-fe00c498-b564-4a92-bec8-95c2893c8b17 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 03 09:23:05.765889 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:06.450706 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-17c51a19-01cd-4a4f-b21d-435346a06677 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "disk": 5, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:06.470006 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:23:06.470006 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:23:06.490505 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-17c51a19-01cd-4a4f-b21d-435346a06677 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.715079 Aug 03 09:23:06.491413 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:06.503126 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-81955cbb-15a9-4c5c-b01f-0568c568f0dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:06.505944 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:23:06.505944 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: warnings.warn(msg) Aug 03 09:23:06.540631 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-81955cbb-15a9-4c5c-b01f-0568c568f0dd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041314 Aug 03 09:23:06.541257 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Aug 3 09:23:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:08.895690 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-17c51a19-01cd-4a4f-b21d-435346a06677 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:08.896864 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-17c51a19-01cd-4a4f-b21d-435346a06677 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003561 Aug 03 09:23:08.901433 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:09.337491 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8fe8aa49-e66d-4aa8-aaa6-bbfac36dcd21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:09.356070 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8fe8aa49-e66d-4aa8-aaa6-bbfac36dcd21 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.451040 Aug 03 09:23:09.356639 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:23:09.369242 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-1fa40b77-5485-4e08-91a1-06cd0501dc33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:09.393419 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-1fa40b77-5485-4e08-91a1-06cd0501dc33 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027924 Aug 03 09:23:09.394038 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Aug 3 09:23:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:23:11.608834 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-8fe8aa49-e66d-4aa8-aaa6-bbfac36dcd21 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:11.609869 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-8fe8aa49-e66d-4aa8-aaa6-bbfac36dcd21 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 03 09:23:11.610437 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:12.046978 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-8e2e7e34-d653-4690-8b5f-f80b9cd8ab1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:12.070163 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-8e2e7e34-d653-4690-8b5f-f80b9cd8ab1b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452694 Aug 03 09:23:12.070712 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:12.083116 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-5c9bc3af-98f4-4197-b8d5-a9edaf5ce1a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:12.107464 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-5c9bc3af-98f4-4197-b8d5-a9edaf5ce1a6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028578 Aug 03 09:23:12.108029 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Aug 3 09:23:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:23:14.323020 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-8e2e7e34-d653-4690-8b5f-f80b9cd8ab1b admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:14.324026 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-8e2e7e34-d653-4690-8b5f-f80b9cd8ab1b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 03 09:23:14.324637 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:14.773521 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:14.792613 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460708 Aug 03 09:23:14.793366 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:14.806111 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-13612765-329f-4cbb-8c4b-d46db1fe2a91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:14.832048 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-13612765-329f-4cbb-8c4b-d46db1fe2a91 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029504 Aug 03 09:23:14.832626 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Wed Aug 3 09:23:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:17.241306 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:17.242148 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 03 09:23:17.242556 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:17.670051 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-137b2c55-28fc-411e-80bc-680ffdb503e3 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:17.695888 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-137b2c55-28fc-411e-80bc-680ffdb503e3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.447299 Aug 03 09:23:17.696345 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Aug 3 09:23:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:19.902979 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:19.903985 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-19b45a72-0a71-4384-9d4b-cd86cec4159e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 03 09:23:19.904387 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:20.383719 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-91d460ea-16da-4fb3-af3b-43091aef1b8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:20.409340 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-91d460ea-16da-4fb3-af3b-43091aef1b8e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.498301 Aug 03 09:23:20.409871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:20.421739 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-1eb3deed-17fd-4726-8059-dc9c6f474824 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:20.447342 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-1eb3deed-17fd-4726-8059-dc9c6f474824 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029211 Aug 03 09:23:20.447875 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Aug 3 09:23:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:22.824427 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-91d460ea-16da-4fb3-af3b-43091aef1b8e admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:22.825566 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-91d460ea-16da-4fb3-af3b-43091aef1b8e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 03 09:23:22.826097 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:23.228336 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-9f96acbe-9c57-4d56-a44e-50e9d0d6866f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:23.247342 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-9f96acbe-9c57-4d56-a44e-50e9d0d6866f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414965 Aug 03 09:23:23.247920 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:23:23.260542 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-e6ea6dba-88ab-4f69-ab62-4626f7b9a06a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:23.284437 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-e6ea6dba-88ab-4f69-ab62-4626f7b9a06a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027809 Aug 03 09:23:23.285242 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Aug 3 09:23:23 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:25.475852 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-9f96acbe-9c57-4d56-a44e-50e9d0d6866f admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:25.476895 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-9f96acbe-9c57-4d56-a44e-50e9d0d6866f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 03 09:23:25.477598 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:25.853708 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-1037945e-83fa-4256-8fd3-df4aaa0ec755 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:25.873026 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-1037945e-83fa-4256-8fd3-df4aaa0ec755 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.389641 Aug 03 09:23:25.873701 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:23:25.887916 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-c8e24f7c-a18f-48d0-b5c2-14f00a392456 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:25.914211 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-c8e24f7c-a18f-48d0-b5c2-14f00a392456 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031239 Aug 03 09:23:25.914767 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Aug 3 09:23:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:28.154107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-1037945e-83fa-4256-8fd3-df4aaa0ec755 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:28.155751 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-1037945e-83fa-4256-8fd3-df4aaa0ec755 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Aug 03 09:23:28.156238 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:28.615830 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e0173265-9831-4de7-a723-b9a5cb08900b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "id": "4", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:28.639550 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-e0173265-9831-4de7-a723-b9a5cb08900b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475955 Aug 03 09:23:28.640256 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:28.653207 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-a0e4cabf-dec3-494d-9918-b6ed439e1a41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:28.681705 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-a0e4cabf-dec3-494d-9918-b6ed439e1a41 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032166 Aug 03 09:23:28.682276 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Aug 3 09:23:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:23:30.896967 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-e0173265-9831-4de7-a723-b9a5cb08900b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:30.897972 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-e0173265-9831-4de7-a723-b9a5cb08900b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 03 09:23:30.898369 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:31.377763 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:31.401858 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497801 Aug 03 09:23:31.402736 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Wed Aug 3 09:23:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:31.415366 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-2ae50be0-ca67-4466-a973-872e1bf60c59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:31.421415 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:31.446622 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-2ae50be0-ca67-4466-a973-872e1bf60c59 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034831 Aug 03 09:23:31.447204 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Wed Aug 3 09:23:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:23:51.011894 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:51.013022 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 03 09:23:51.013429 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:51.024360 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:51.411581 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-24b7f64a-730f-4a16-a03c-56e5de854b30 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:51.430320 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-24b7f64a-730f-4a16-a03c-56e5de854b30 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410953 Aug 03 09:23:51.430791 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Aug 3 09:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:52.492799 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:52.493822 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-6d7a67aa-2944-4ed6-9979-58bf69345983 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 03 09:23:52.494224 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:53.022366 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4ecf1968-c1ee-4dac-9294-f79bf3237e1d admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:53.027918 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-4ecf1968-c1ee-4dac-9294-f79bf3237e1d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4ecf1968-c1ee-4dac-9294-f79bf3237e1d admin admin] Request method failure captured: Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept: application/json Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Connection: keep-alive Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Content-Length: 0 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Host: 10.222.0.20 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABi6j6oeJVnjLlbEHro6XBLXXoTcVncliGpJpGj6jsS_lRBbLs9dCKjJrjlITpqIgTlbIyCHW2f7eBUMI2TzrPa9vxDpDjeX3gBeb1J_rcfdwuVflhGdOgi5kfYPll4R_YvkMVlFfoNfhysp8JWzeLDOKqkC9D5v2oLVQlN4wQX8y5MqM0 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Role: admin,member,reader Aug 03 09:23:53.031173 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Roles: admin,member,reader Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant: admin Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User: admin Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Name: admin Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: method: > Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: exception: Flavor 42 could not be found. Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: action_args: {'id': '42'} Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:53.032594 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:53.033603 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.035039 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-4ecf1968-c1ee-4dac-9294-f79bf3237e1d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:53.036647 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-4ecf1968-c1ee-4dac-9294-f79bf3237e1d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398632 Aug 03 09:23:53.036647 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 3 09:23:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 09:23:53.042111 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-32105424-c3f7-4ab1-8d3d-088c0f64f6fd admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:53.054876 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:23:53.065404 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-32105424-c3f7-4ab1-8d3d-088c0f64f6fd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026794 Aug 03 09:23:53.065960 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:53.076959 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-19e781f0-01f1-4542-a7ef-8300d35d3f6e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:53.100698 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-19e781f0-01f1-4542-a7ef-8300d35d3f6e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027306 Aug 03 09:23:53.101263 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:23:53.110866 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-107c6299-9778-4a58-9d20-2c2317d06993 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:53.117851 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.wsgi [None req-107c6299-9778-4a58-9d20-2c2317d06993 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-107c6299-9778-4a58-9d20-2c2317d06993 admin admin] Request method failure captured: Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept: application/json Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept-Encoding: gzip, deflate Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Connection: keep-alive Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Content-Length: 0 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Host: 10.222.0.20 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-System-Scope: None Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: User-Agent: python-novaclient Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Auth-Token: gAAAAABi6j6oeJVnjLlbEHro6XBLXXoTcVncliGpJpGj6jsS_lRBbLs9dCKjJrjlITpqIgTlbIyCHW2f7eBUMI2TzrPa9vxDpDjeX3gBeb1J_rcfdwuVflhGdOgi5kfYPll4R_YvkMVlFfoNfhysp8JWzeLDOKqkC9D5v2oLVQlN4wQX8y5MqM0 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Id: None Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Name: None Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Identity-Status: Confirmed Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Is-Admin-Project: True Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Id: default Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Name: Default Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Name: admin Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Role: admin,member,reader Aug 03 09:23:53.121077 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Roles: admin,member,reader Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant: admin Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Name: admin Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User: admin Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Id: default Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Name: Default Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Name: admin Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: method: > Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: exception: Flavor 42 could not be found. Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: action_args: {'id': '42'} Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:53.122671 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:53.123459 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:53.124483 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-107c6299-9778-4a58-9d20-2c2317d06993 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:53.125528 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-107c6299-9778-4a58-9d20-2c2317d06993 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015452 Aug 03 09:23:53.125528 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 3 09:23:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 09:23:54.102806 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-19e781f0-01f1-4542-a7ef-8300d35d3f6e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:54.103803 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-19e781f0-01f1-4542-a7ef-8300d35d3f6e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 03 09:23:54.104190 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:54.634304 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-3ae9d0be-97b3-41ff-af7e-37f23c65282b admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:54.639567 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.wsgi [None req-3ae9d0be-97b3-41ff-af7e-37f23c65282b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-3ae9d0be-97b3-41ff-af7e-37f23c65282b admin admin] Request method failure captured: Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept: application/json Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept-Encoding: gzip, deflate Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Connection: keep-alive Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Content-Length: 0 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Host: 10.222.0.20 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-System-Scope: None Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: User-Agent: python-novaclient Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Auth-Token: gAAAAABi6j6pj3X7pXT4Jof4d8QsP9tlwtMq_m29Lb5Ufj6H_Fc2Jq0aSd4BE8v1r5QLdlbkkrc2eVDHN9wnyRJIGsUOqaniMunvVQ_0Uw86ECBGapPD09qQj9KEVgYYYSkwiYZAzHwkwkwnEb_Pw48-Ic5PmIouVqvaxTnihstJUtLqnj5DPms Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Id: None Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Name: None Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Identity-Status: Confirmed Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Is-Admin-Project: True Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Id: default Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Name: Default Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Name: admin Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Role: admin,member,reader Aug 03 09:23:54.641092 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Roles: admin,member,reader Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant: admin Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Name: admin Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User: admin Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Id: default Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Name: Default Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Name: admin Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: method: > Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: exception: Flavor 84 could not be found. Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: action_args: {'id': '84'} Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:54.642646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:54.643721 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.645107 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-3ae9d0be-97b3-41ff-af7e-37f23c65282b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:54.646524 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-3ae9d0be-97b3-41ff-af7e-37f23c65282b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394069 Aug 03 09:23:54.646524 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 3 09:23:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 09:23:54.652170 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-de078d88-5c3a-4f29-8ffe-ee75529c6385 admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:54.667246 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-de078d88-5c3a-4f29-8ffe-ee75529c6385 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018608 Aug 03 09:23:54.667772 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:54.677555 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-72a10881-b14c-4196-9a39-dc035e1b6f38 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:54.692159 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-72a10881-b14c-4196-9a39-dc035e1b6f38 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018744 Aug 03 09:23:54.692675 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:54.701772 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-05632215-2c08-4ad8-84de-6bb42547b74d admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:54.707091 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-05632215-2c08-4ad8-84de-6bb42547b74d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-05632215-2c08-4ad8-84de-6bb42547b74d admin admin] Request method failure captured: Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept: application/json Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Connection: keep-alive Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Content-Length: 0 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Host: 10.222.0.20 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABi6j6pj3X7pXT4Jof4d8QsP9tlwtMq_m29Lb5Ufj6H_Fc2Jq0aSd4BE8v1r5QLdlbkkrc2eVDHN9wnyRJIGsUOqaniMunvVQ_0Uw86ECBGapPD09qQj9KEVgYYYSkwiYZAzHwkwkwnEb_Pw48-Ic5PmIouVqvaxTnihstJUtLqnj5DPms Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Role: admin,member,reader Aug 03 09:23:54.708656 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Roles: admin,member,reader Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant: admin Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User: admin Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Name: admin Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: method: > Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: exception: Flavor 84 could not be found. Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: action_args: {'id': '84'} Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:54.710195 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:54.711241 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:54.712544 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-05632215-2c08-4ad8-84de-6bb42547b74d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:54.713790 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-05632215-2c08-4ad8-84de-6bb42547b74d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011679 Aug 03 09:23:54.713790 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Wed Aug 3 09:23:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 09:23:55.677008 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-72a10881-b14c-4196-9a39-dc035e1b6f38 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:55.678020 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-72a10881-b14c-4196-9a39-dc035e1b6f38 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 03 09:23:55.678417 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:56.207621 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ca150ab7-ed8e-4411-b2e4-3bad118de62c admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:56.214468 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.wsgi [None req-ca150ab7-ed8e-4411-b2e4-3bad118de62c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ca150ab7-ed8e-4411-b2e4-3bad118de62c admin admin] Request method failure captured: Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept: application/json Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Accept-Encoding: gzip, deflate Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Connection: keep-alive Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Content-Length: 0 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Host: 10.222.0.20 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Openstack-System-Scope: None Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: User-Agent: python-novaclient Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Auth-Token: gAAAAABi6j6ru_qxyx5YScSC9VBXXD6Y87sIAmGWd1QYEfZVSVztncW-KhF2IPrmIz9z-yKMuH3QHb6XREwNFdVGOc--bo8KnNVbqYmVz2Wb3T2AL94Z9hyM9NZUkPEp2gf2c6xiwW-3d2atCyIOtG7n7xRAv6ZSOmTMvjeqRqBd0tJSB1Evhlk Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Id: None Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Domain-Name: None Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Identity-Status: Confirmed Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Is-Admin-Project: True Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Id: default Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Domain-Name: Default Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Project-Name: admin Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Role: admin,member,reader Aug 03 09:23:56.215965 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Roles: admin,member,reader Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant: admin Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-Tenant-Name: admin Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User: admin Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Id: default Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Domain-Name: Default Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: X-User-Name: admin Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: method: > Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: exception: Flavor 451 could not be found. Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: action_args: {'id': '451'} Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:56.217565 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:56.218428 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.219523 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ca150ab7-ed8e-4411-b2e4-3bad118de62c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103198) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:56.220528 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ca150ab7-ed8e-4411-b2e4-3bad118de62c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400778 Aug 03 09:23:56.220528 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:23:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 03 09:23:56.227377 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-8ade913b-d5cc-443d-bd0e-07cde644eb48 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:56.242442 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-8ade913b-d5cc-443d-bd0e-07cde644eb48 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018827 Aug 03 09:23:56.242968 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:56.252287 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:56.267451 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018614 Aug 03 09:23:56.267967 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Wed Aug 3 09:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:23:56.277809 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-c580cfa7-c4f3-46b9-a753-deb82f14440f admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:56.283001 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.wsgi [None req-c580cfa7-c4f3-46b9-a753-deb82f14440f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-c580cfa7-c4f3-46b9-a753-deb82f14440f admin admin] Request method failure captured: Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept: application/json Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Accept-Encoding: gzip, deflate Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Connection: keep-alive Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Content-Length: 0 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Host: 10.222.0.20 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-Api-Version: compute 2.90 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Openstack-System-Scope: None Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: User-Agent: python-novaclient Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Auth-Token: gAAAAABi6j6ru_qxyx5YScSC9VBXXD6Y87sIAmGWd1QYEfZVSVztncW-KhF2IPrmIz9z-yKMuH3QHb6XREwNFdVGOc--bo8KnNVbqYmVz2Wb3T2AL94Z9hyM9NZUkPEp2gf2c6xiwW-3d2atCyIOtG7n7xRAv6ZSOmTMvjeqRqBd0tJSB1Evhlk Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Id: None Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Domain-Name: None Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Identity-Status: Confirmed Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Is-Admin-Project: True Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Openstack-Nova-Api-Version: 2.90 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Id: default Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Domain-Name: Default Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Project-Name: admin Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Role: admin,member,reader Aug 03 09:23:56.284488 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Roles: admin,member,reader Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad425f1b4ca042f3a03f2045c7a1ec98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad425f1b4ca042f3a03f2045c7a1ec98"}]}] Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant: admin Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Id: ad425f1b4ca042f3a03f2045c7a1ec98 Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-Tenant-Name: admin Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User: admin Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Id: default Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Domain-Name: Default Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Id: 10b321b418404be2bfd6270c2ccc714a Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: X-User-Name: admin Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: method: > Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: exception: Flavor 451 could not be found. Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: action_args: {'id': '451'} Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:23:56.286954 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:56.288094 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: ERROR nova.api.openstack.wsgi Aug 03 09:23:56.289316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-c580cfa7-c4f3-46b9-a753-deb82f14440f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:23:56.290382 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-c580cfa7-c4f3-46b9-a753-deb82f14440f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011454 Aug 03 09:23:56.290382 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:23:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 03 09:23:57.246234 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:57.247231 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 03 09:23:57.247618 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:57.767298 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-490f0bb4-f81c-40f9-9921-25a6e8cca188 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:57.787523 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-490f0bb4-f81c-40f9-9921-25a6e8cca188 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402972 Aug 03 09:23:57.788068 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 3 09:23:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:23:58.759893 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:23:58.760930 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 03 09:23:58.761323 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:23:59.290871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-c2c8bab0-e873-42ef-a453-827a9625d28d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:23:59.309409 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-c2c8bab0-e873-42ef-a453-827a9625d28d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.410553 Aug 03 09:23:59.309947 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 3 09:23:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:24:00.306542 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:00.307541 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 03 09:24:00.307935 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:24:00.837885 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-bf5874ca-6e77-4b96-b95d-989ff8a2fdfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:24:00.856978 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-bf5874ca-6e77-4b96-b95d-989ff8a2fdfc admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.410848 Aug 03 09:24:00.857517 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 3 09:24:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:24:01.824095 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:01.825121 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 03 09:24:01.825512 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:24:02.368316 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-a8dc3793-b556-4ed3-8a4c-19177c449aa9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:24:02.387286 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-a8dc3793-b556-4ed3-8a4c-19177c449aa9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.418439 Aug 03 09:24:02.387830 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Wed Aug 3 09:24:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:24:03.360160 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:03.361198 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 03 09:24:03.361596 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:24:03.887386 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-3d393e06-0ae4-4df4-ab75-8f9778a09f99 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:03.908051 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-3d393e06-0ae4-4df4-ab75-8f9778a09f99 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402936 Aug 03 09:24:03.908582 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Wed Aug 3 09:24:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:24:55.474918 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.475930 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-ff12014f-a045-4c42-bfac-ea144c13756e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 03 09:24:55.477104 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:24:55.487706 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:24:55.875943 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-06621bc0-2e76-47d9-a588-2ba875f8cecd admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.897553 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-06621bc0-2e76-47d9-a588-2ba875f8cecd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.414233 Aug 03 09:24:55.898054 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:24:55.921894 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-227971d6-5343-4dda-a4f9-2b6480fc71ff admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.925404 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG dbcounter [-] [103198] Writing DB stats nova_api:SELECT=14 {{(pid=103198) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:24:55.931368 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-227971d6-5343-4dda-a4f9-2b6480fc71ff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013123 Aug 03 09:24:55.931903 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:24:55.943582 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-f807626b-ba77-4a01-9d45-cc2721d7eeff admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.952115 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-f807626b-ba77-4a01-9d45-cc2721d7eeff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012105 Aug 03 09:24:55.952646 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:24:55.964359 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.971938 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Aug 03 09:24:55.972452 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:24:55.983759 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-379d2850-22d0-484e-89be-324a22abf916 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:24:55.991422 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-379d2850-22d0-484e-89be-324a22abf916 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011171 Aug 03 09:24:55.992555 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Wed Aug 3 09:24:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:28:18.237290 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:18.238285 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 03 09:28:18.238673 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:28:18.379942 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_api:SELECT=6 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:28:18.538166 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:18.541063 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:28:18.541063 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:28:18.542430 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:18.542871 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:18.543650 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:18.544070 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:18.578585 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-2f3ecc5c-60c7-434b-9d6d-e6e892373b7d admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200026 Aug 03 09:28:18.579132 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:28:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:28:19.413937 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:19.414929 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 03 09:28:19.415418 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:28:19.610059 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:19.612469 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:28:19.612469 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:28:19.613687 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:19.614143 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:19.614935 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:19.615359 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:19.636437 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-81aec405-6812-4890-8058-3dd584ff7019 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081837 Aug 03 09:28:19.636981 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:28:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:28:30.869128 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:30.870156 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 03 09:28:30.870548 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:28:31.014430 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_cell0:SELECT=4 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:28:31.015144 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_cell1:SELECT=4 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:28:31.015753 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG dbcounter [-] [103197] Writing DB stats nova_api:SELECT=8 {{(pid=103197) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:28:31.064209 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:31.067002 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:28:31.067002 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:28:31.068244 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:31.068681 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:31.069498 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:31.069923 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:31.095592 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-d7e5d9c5-e1b6-4de6-b462-ed8139ec6db8 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085442 Aug 03 09:28:31.096074 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:28:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:28:31.925326 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: DEBUG nova.api.openstack.wsgi [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] Calling method '>' {{(pid=103198) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:31.926322 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: INFO nova.api.openstack.requestlog [None req-76961eac-ab39-4fe0-aa91-c572e0b8605b admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 03 09:28:31.926707 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: [pid: 103198|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Wed Aug 3 09:28:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:28:32.118242 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG nova.api.openstack.wsgi [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] Calling method '>' {{(pid=103197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:28:32.120756 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 03 09:28:32.120756 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: warnings.warn(msg) Aug 03 09:28:32.122055 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:32.122490 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:32.123277 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:28:32.123702 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: DEBUG oslo_concurrency.lockutils [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:28:32.144960 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: INFO nova.api.openstack.requestlog [None req-86c3ad9e-d26e-4a8e-97d7-b1bcf2f2ce33 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079883 Aug 03 09:28:32.145443 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: [pid: 103197|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Wed Aug 3 09:28:32 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:29:26.453028 dv-cinder-844563-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 03 09:29:26.453885 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: Wed Aug 3 09:29:26 2022 - graceful shutdown triggered... Aug 03 09:29:26.454380 dv-cinder-844563-5-iscsi devstack@n-api.service[103197]: Gracefully killing worker 1 (pid: 103197)... Aug 03 09:29:26.454768 dv-cinder-844563-5-iscsi devstack@n-api.service[103198]: Gracefully killing worker 2 (pid: 103198)... Aug 03 09:29:27.455039 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: worker 1 buried after 1 seconds Aug 03 09:29:27.455579 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: worker 2 buried after 1 seconds Aug 03 09:29:27.455579 dv-cinder-844563-5-iscsi devstack@n-api.service[103196]: goodbye to uWSGI. Aug 03 09:29:27.456678 dv-cinder-844563-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 03 09:29:27.457257 dv-cinder-844563-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 03 09:29:27.460113 dv-cinder-844563-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 03 09:29:27.470057 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 3 09:29:27 2022] *** Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: nodename: dv-cinder-844563-5-iscsi Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: machine: x86_64 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: clock source: unix Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: pcre jit disabled Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: detected number of CPU cores: 4 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: current working directory: / Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: detected binary path: /usr/bin/uwsgi-core Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: your processes number limit is 47680 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: your memory page size is 4096 bytes Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: detected max file descriptor number: 2048 Aug 03 09:29:27.472660 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: lock engine: pthread robust mutexes Aug 03 09:29:27.473626 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: thunder lock: enabled Aug 03 09:29:27.473626 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 03 09:29:27.473626 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 03 09:29:27.512469 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: Python main interpreter initialized at 0x5651e18999c0 Aug 03 09:29:27.512469 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: python threads support enabled Aug 03 09:29:27.512469 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: your server socket listen backlog is limited to 100 connections Aug 03 09:29:27.512469 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: your mercy for graceful operations on workers is 90 seconds Aug 03 09:29:27.512880 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: mapped 403077 bytes (393 KB) for 2 cores Aug 03 09:29:27.512969 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: *** Operational MODE: preforking *** Aug 03 09:29:27.513176 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: *** uWSGI is running in multiple interpreter mode *** Aug 03 09:29:27.513176 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: spawned uWSGI master process (pid: 117917) Aug 03 09:29:27.513373 dv-cinder-844563-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 03 09:29:27.513926 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: spawned uWSGI worker 1 (pid: 117928, cores: 1) Aug 03 09:29:27.514276 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: spawned uWSGI worker 2 (pid: 117929, cores: 1) Aug 03 09:29:27.514425 dv-cinder-844563-5-iscsi devstack@n-api.service[117917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 03 09:29:28.185393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 09:29:28.185879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 03 09:29:29.343467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:29:29.343467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: from cryptography.utils import int_from_bytes Aug 03 09:29:29.344085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:29:29.344085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: from cryptography.utils import int_from_bytes Aug 03 09:29:29.368994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:29:29.368994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: from cryptography.utils import int_from_bytes Aug 03 09:29:29.369594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 03 09:29:29.369594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: from cryptography.utils import int_from_bytes Aug 03 09:29:31.796417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 09:29:31.797038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 09:29:31.797350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 09:29:31.797550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 09:29:31.797788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 09:29:31.798188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.798520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.798846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.799164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.799504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.799819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.800151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.800464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.800801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.801096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.801420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.801750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-5-iscsi {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.802081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.802572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.802887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.803622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.804192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.804605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.804955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.805479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.806963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.806963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.806963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.806963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.807291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.807519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.807834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.808132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.808464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.808778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.809221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-5-iscsi {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.809543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.809859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.810184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.810603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.810911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.811222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.811576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.811923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.812245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.812569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.812923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.813246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.813563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.813866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.814178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.814495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.814819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.815128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.815440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.815692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.816002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.816327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.816651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.817282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.817538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.817792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.818116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.818444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.818784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.819171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.819843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.820098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.820414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.820727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.821062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.821375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.821706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.822025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.822354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.822666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.822991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.823408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.823662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.823971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.824321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.824645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.824981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.825308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.825633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.825942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.826251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.826558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.826881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.827230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.827543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.827797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.828286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.828771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.829131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.829442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.829754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.830063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.830366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.830674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.830981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.831287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.831593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.831900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.832206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.832514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.832841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.833150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.833475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.833800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.834107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.834975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.835379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.835954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.836319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.836633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.836973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.837301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.837618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.837941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.838261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.838572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.838895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.839208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.839510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.839817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.840139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.840444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.840755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.841087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.841394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.841703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.842011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.842315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.842619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.842921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.843243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.843565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.843876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.844185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.844493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.844834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.845180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.845516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.845862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.846176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.846513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.846846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.847165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.847480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.847648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 03 09:29:31.848185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.848362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 03 09:29:31.848553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.848729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 03 09:29:31.848898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.849060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 03 09:29:31.849232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.849389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 03 09:29:31.849567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.849717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.849876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.849876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.850797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.850797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.851108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.851821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.851984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.852137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.852137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.852423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.852576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.852727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.852903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.853053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.853207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.853361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.853523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.853675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.853828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.853979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.854123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-5-iscsi {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.854280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.854425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.854567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.854719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.854873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.855024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.855182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.855336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.855487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.855638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.855782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.855925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.856087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.856230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.856373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.856373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.856661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.856874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.857048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.857194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.857337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.857486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.857643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.857801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.857946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.858097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.858240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.858383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.858535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.858728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.858885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.858885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.859184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.859184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.859466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.859466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.859753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.859753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.860027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-5-iscsi {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.860183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.860328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.860477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.860629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.860778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.861050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.861247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.862048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.862205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.862357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.862512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.862655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.862808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.862952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.863104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.863248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.863398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.863567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.863719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.863863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.864013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.864164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.864315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.864469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.864621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.864765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.864950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.865106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.865258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.865416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.865599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.865750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.865893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.866045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.866196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.866355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.866500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.866643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.866792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.866952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.867109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.867259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.867259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.867567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.867726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.867877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.868099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.868249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.868401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.868556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.868741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.868924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.869071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.869221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.869384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.869530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.869681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.869833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.869977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.870126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.870270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.870420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.870565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.870717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.870868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.871019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.871162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.871162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.871443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.872240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.872393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.872540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.872691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.872869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.873030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.873182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.873326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.873476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.873631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.873783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.873954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.874113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.874256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.874408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.874559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.874710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.874868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.875018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.875169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.875319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.875462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.875612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.875779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.875940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.876091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.876242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.876395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.876545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.876689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.876884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.877126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.877291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.877455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.877607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.877761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.877761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.878054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.878205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.878359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.878359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.878649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.878835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.878994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.879145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.879289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.879432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.879587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.879730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.879892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.880037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.880179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.880331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.880487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.880639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.880790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.880970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.881732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.882554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.882710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.882868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.883026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.883179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.883323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.883474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.883474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.883746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.883899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.884050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.884195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.884337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.884492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.884806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.885015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.885171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.885315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.885459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.885610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.885761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.885911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.886062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.886214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.886368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.886511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.886662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.886816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.886816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.887106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.887257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.887406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.887558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.887702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.887863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.888007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.888007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.888288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.888438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.888599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.888756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.888966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.889117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.889269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.889415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.889567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.889719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.889862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.890014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.890164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.890315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.890475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.890639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.890790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.890935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.891085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.891229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.891385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.891538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.891681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.891824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.893377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.893552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.893719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.893866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.894030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.894175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.894329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.894481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.894639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.894792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.894937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.895088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.895235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.895385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.895525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.895665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.895805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.895955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.896097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.896324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 03 09:29:31.896468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.896620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.896762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.897967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.898893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.899988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.900977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.901948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.902032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.902161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.902554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.903864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.904999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.905929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.906982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.907908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.908118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.908225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.908430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.908710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.908834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.909979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.910934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.911992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.912192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.912315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.912752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.913855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.914892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.915932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.916983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.917882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.918853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.919810 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.920975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.921065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.921328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.921429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.921636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.921947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.922270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.922366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.922605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.922726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.922966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.923262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.923600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.923700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.923890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.924024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.924197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.924348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.924524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.924674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.925908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.926065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.926236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.926365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.926694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.927011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.927322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.927643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.927956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.928058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.928802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.928921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.929182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.929424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.929530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.929747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.929863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.930070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.930177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.930578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.930746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.930892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.931949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.932102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.932244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.932387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.932535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.932778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.933823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.934991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.935927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.936983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.937894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.938812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.939948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.940939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.941047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.941251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.941351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.941560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.941652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.942846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.943975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.944135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.944261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.944353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.944739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.944879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.945792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.946935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.947984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.948196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.948290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.948496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.948589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.948797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.949855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.950982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.951997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.952210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.952312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.952524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.952618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.952909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.953895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.954909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.955966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.956905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.957114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.957303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.957430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.957619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.957934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.958962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.959182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.959274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.960241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.960344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.960643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.960845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.960999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.961964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.962130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.962859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.962980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.963821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.964932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.965857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.966817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.967946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.968936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.969911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.970944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.971854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.972786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.973992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.974915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.975151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.975298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.975504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.975604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.975892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.976878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.977831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.978949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.979968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.980943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.981862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.982964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.983865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.984797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.985934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.986952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.987855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.988854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.989805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.990021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.990122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.990332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.990426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.991162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.991274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.991480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.991759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.991859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.992791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.993977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.994898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.995894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.996799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.997965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.998991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:31.999917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.000853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.001059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.001152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.001362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.001467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.001772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.002803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.003937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.004898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.005894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.006928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.007251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.007353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.007555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.007655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.007862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.008876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.009878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.010879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.011809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.012972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.013904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.014951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.015930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.016880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.017846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.018967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.019980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.020928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.021127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.021305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.021449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.021541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.021747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.022372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.022616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.022724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.022933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.023976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.024966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.025850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.026830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.027845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.028997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.029990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.030899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.031824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.032984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.033898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.034936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.035885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.036839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.037973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.038127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.038400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.038508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.038714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.038857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.039967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.040149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.040285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.040470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.040791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.040942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.041867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.042812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.043952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.044949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.045921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.046901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.047900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.048891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.049992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.050917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.051954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.052920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.053604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.053834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.054119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.054247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.054482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.054618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.055892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.056967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.057900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.058840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.059958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.060934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.061969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.062893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.063817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.064977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.065991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.066203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.066296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.066508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.066602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.067992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.068084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.068293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.068394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.068602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.068739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.069891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.070868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.071090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.071183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.071402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.071504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.071685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117928) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 09:29:32.071827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.072015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.072417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.072742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.073078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.073392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.073738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.074059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.074595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.074931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.075250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.075586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.075915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.076221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.076528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.076850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.077177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.078562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.078562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.078562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.078562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.078885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.079055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.079310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.079620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.079929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.080238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.080547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.080880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.081343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.081813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.082268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.082761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.083414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.083887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.084869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.085330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.085823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.086894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.087480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.089061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.090057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.090569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.091062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.091815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.092425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.092991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.093467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.093966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.094439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.094932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.095422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.095902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.096392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.096896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.097489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.098086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.098701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.099293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.099689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.100181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.100565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.101066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.101553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.104544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.105015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.105420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.106799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.107488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.107909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.108233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.108734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.109245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.109731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.110206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.110774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.111365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.111917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.112464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.113035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.113518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.113984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.114454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.114934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.115395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.116244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.116777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.117397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.117942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.118416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.119016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.119486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.119987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.120547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.121207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.121682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.122212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.122699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.123169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.123639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.124121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.124704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.125257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.125745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.126235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.126864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.127382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.127858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.128380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.128971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.129438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.129954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.130433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.131007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.132040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.132508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.133010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.133499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.133965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.134429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.134912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.135296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Registered counter for database nova_api Aug 03 09:29:32.135702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.136227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.136763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.137281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.137778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.138263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.138872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.139391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.139905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.140468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.140991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.141504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.142057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 03 09:29:32.142454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117929) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 03 09:29:32.155903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.163699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.207462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Registered counter for database nova_api Aug 03 09:29:32.224883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.context [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dd4996a-81ed-45f2-a688-0b41f856dafc(cell1) {{(pid=117928) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 09:29:32.229865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:29:32.230093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.231488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:29:32.232344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:29:32.234496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:29:32.236583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Registered counter for database nova_cell0 Aug 03 09:29:32.237722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.241101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Registered counter for database nova_cell1 Aug 03 09:29:32.249214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.251823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.260224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.261679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.296029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.context [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dd4996a-81ed-45f2-a688-0b41f856dafc(cell1) {{(pid=117929) load_cells /opt/stack/nova/nova/context.py:464}} Aug 03 09:29:32.300956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:29:32.302903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:29:32.303768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:29:32.306098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:29:32.308146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Registered counter for database nova_cell0 Aug 03 09:29:32.312242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Registered counter for database nova_cell1 Aug 03 09:29:32.320968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.322543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.332252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.335294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.420411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO dbcounter [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Registered counter for database nova_cell0 Aug 03 09:29:32.427149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_db.sqlalchemy.engines [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117928) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.432025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writer thread running {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.486691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO dbcounter [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Registered counter for database nova_cell0 Aug 03 09:29:32.494151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_db.sqlalchemy.engines [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117929) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 03 09:29:32.498840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writer thread running {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 03 09:29:32.764224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:29:32.771625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:29:32.828319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:29:32.836316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:29:33.114234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:29:33.120965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: WARNING keystonemiddleware.auth_token [None req-480f6c03-59f8-4302-83b8-599aba746b99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:29:33.126329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651e18999c0 pid: 117928 (default app) Aug 03 09:29:33.188334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 03 09:29:33.195711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: WARNING keystonemiddleware.auth_token [None req-44760120-c01c-4c16-967e-3aa6771ac33e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 03 09:29:33.201321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651e18999c0 pid: 117929 (default app) Aug 03 09:30:12.516513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:12.525902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:12.531924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:12.534156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:13.520142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3edff472-a166-431a-9e45-31dbe1712098 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Action: 'create', calling method: .version_select at 0x7fb99ab17040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-869151965"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:15.621132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3edff472-a166-431a-9e45-31dbe1712098 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.124752 Aug 03 09:30:15.622792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Wed Aug 3 09:30:12 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3135 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 03 09:30:16.127239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-77a3500e-b2d1-419c-bee6-9d688cec9ae6 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99acf80d0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:16.233467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:16.238584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:16.241496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:16.243753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:17.622573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-77a3500e-b2d1-419c-bee6-9d688cec9ae6 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 200 len: 345 microversion: 2.1 time: 1.988205 Aug 03 09:30:17.623282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:15 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 345 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:17.637052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1ecf2d62-f841-4ce0-9ef7-3ba13aedacf5 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Action: 'create', calling method: .version_select at 0x7fb99aa96e50>, body: {"snapshot": {"volume_id": "87549584-dbe0-4929-a7f1-8ed6b9347b23", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1284131493"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:18.025591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1ecf2d62-f841-4ce0-9ef7-3ba13aedacf5 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.392728 Aug 03 09:30:18.032419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1162 bytes} [Wed Aug 3 09:30:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:30:18.038154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2341ab65-5324-49b9-a007-a7638daf6a30 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aac9e50>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:18.103885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2341ab65-5324-49b9-a007-a7638daf6a30 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 287 microversion: 2.1 time: 0.070354 Aug 03 09:30:18.104456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:18 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:30:18.118567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c5ef485c-1010-4e3e-b06c-e3464d9eede7 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aab2040>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:18.239094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c5ef485c-1010-4e3e-b06c-e3464d9eede7 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126449 Aug 03 09:30:18.240443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 3 09:30:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:18.252976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-51333bd9-7605-460d-88e2-b769c591b4bb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa8f040>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:18.462197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-51333bd9-7605-460d-88e2-b769c591b4bb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 287 microversion: 2.1 time: 0.214090 Aug 03 09:30:18.462928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:18 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 287 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:19.474904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e827af41-5d21-4f6e-b936-bc25c3cbdf96 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aaa7c10>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:19.510977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e827af41-5d21-4f6e-b936-bc25c3cbdf96 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 287 microversion: 2.1 time: 0.040852 Aug 03 09:30:19.516739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:19 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:20.524393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0c6de093-b42b-45ee-9dd0-a3f8093717fb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa8f700>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:20.607736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0c6de093-b42b-45ee-9dd0-a3f8093717fb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 287 microversion: 2.1 time: 0.088027 Aug 03 09:30:20.608655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:20 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:21.621259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81864a07-e2a8-48fe-ae08-0ddf978238f9 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aaa74c0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:22.058374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81864a07-e2a8-48fe-ae08-0ddf978238f9 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 288 microversion: 2.1 time: 0.441221 Aug 03 09:30:22.063315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:21 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 288 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:22.075110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-093cfaff-4dd8-45c6-bc9f-a6cdb0d1aed5 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa8fdc0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:22.300361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-093cfaff-4dd8-45c6-bc9f-a6cdb0d1aed5 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 202 len: 0 microversion: 2.1 time: 0.229302 Aug 03 09:30:22.301333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1254 bytes} [Wed Aug 3 09:30:22 2022] DELETE /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 09:30:22.309761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad09ba22-ec68-4d34-a4ae-21fd5715c2fd tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa96ee0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:22.593222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad09ba22-ec68-4d34-a4ae-21fd5715c2fd tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 200 len: 287 microversion: 2.1 time: 0.287163 Aug 03 09:30:22.594915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:22 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 287 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:23.608597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c244728-276f-4b92-8413-b84fa79d3dfb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa8faf0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:23.685005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-8c244728-276f-4b92-8413-b84fa79d3dfb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] HTTP exception thrown: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c244728-276f-4b92-8413-b84fa79d3dfb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Request method failure captured: Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a HTTP/1.1 Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kAk4FThXygyvV-hYEpdC5AHEYAfDUfgrLUiKSljx2kvtUd2KRSUNncMpipMROIUcWmCg1C5Qv2TiJiUQpAHVEGa9N9BQFRqpF3VdUQDPxdmMJ98aUzdn6O4i5dqAOV4Fcj2ygwAP_QswtRJ14ZHJHGitzf08SmRylqDG_nCql0aGgk Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:30:23.689143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}] Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 4db0180026ae46838dcccf820278e06c Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '53cef0cf-f00d-41aa-8a3c-4307e4bec88a'} Aug 03 09:30:23.690376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. (HTTP 404) (Request-ID: req-e2bd6111-4d0b-46eb-908b-c7f8cdca10c3) Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.691148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:23.692389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 03 09:30:23.693716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c244728-276f-4b92-8413-b84fa79d3dfb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Returning 404 to user: Snapshot 53cef0cf-f00d-41aa-8a3c-4307e4bec88a could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c244728-276f-4b92-8413-b84fa79d3dfb tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a" status: 404 len: 111 microversion: 2.1 time: 0.088099 Aug 03 09:30:23.694997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:30:23 2022] GET /compute/v2.1/os-snapshots/53cef0cf-f00d-41aa-8a3c-4307e4bec88a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:30:23.700281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-baad3a02-f4f6-4213-b1df-e233df8bede6 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aaa7f70>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:23.836697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-baad3a02-f4f6-4213-b1df-e233df8bede6 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 202 len: 0 microversion: 2.1 time: 0.139415 Aug 03 09:30:23.837208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:30:23 2022] DELETE /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:30:23.848705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e8d812a9-8e78-4139-8b09-2ce8c8472a69 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99b2ee940>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:24.017303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e8d812a9-8e78-4139-8b09-2ce8c8472a69 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 200 len: 344 microversion: 2.1 time: 0.175720 Aug 03 09:30:24.018193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 7/14] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:23 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:25.039908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b5db132a-e6f6-4b3f-8428-0f1e15709a59 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aaa7790>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:25.174044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b5db132a-e6f6-4b3f-8428-0f1e15709a59 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 200 len: 344 microversion: 2.1 time: 0.146337 Aug 03 09:30:25.174760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:25 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:26.189590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd5dc2d3-f4a6-4084-a5e9-1746ba523f14 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa55940>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:26.259604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd5dc2d3-f4a6-4084-a5e9-1746ba523f14 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 200 len: 344 microversion: 2.1 time: 0.074496 Aug 03 09:30:26.261576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:26 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:26.945848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-90d8e746-e459-4944-ba6d-beadbabef0e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'create', calling method: .version_select at 0x7fb99aaa7ee0>, body: {"keypair": {"name": "tempest-keypair-1655844225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFz7lm86qj5svh/jqrCEGzAhDShwKKItTIWQSpTzoM730K1jKxdTYkF7R2esG6vXIgU8HQK91lueLwaGIfRVo7gNpPS+4l9j/CdQ2Uipz1HPMpbyquG2MPt4WvPssnWAw=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:27.114770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-90d8e746-e459-4944-ba6d-beadbabef0e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for project 0e293737b69a41e79fdcdbb99baca498. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:27.134211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-90d8e746-e459-4944-ba6d-beadbabef0e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for user 29203ff4c61c48fd940e6ac6c51e5fea and project 0e293737b69a41e79fdcdbb99baca498. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:27.268112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-90d8e746-e459-4944-ba6d-beadbabef0e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.665016 Aug 03 09:30:27.271526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 9/17] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:30:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:30:27.285868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9ebdd1a-1e25-4140-a2b7-ea5e59b4e45b tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa55f70>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:27.352857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-f9ebdd1a-1e25-4140-a2b7-ea5e59b4e45b tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] HTTP exception thrown: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9ebdd1a-1e25-4140-a2b7-ea5e59b4e45b tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Request method failure captured: Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 HTTP/1.1 Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kAk4FThXygyvV-hYEpdC5AHEYAfDUfgrLUiKSljx2kvtUd2KRSUNncMpipMROIUcWmCg1C5Qv2TiJiUQpAHVEGa9N9BQFRqpF3VdUQDPxdmMJ98aUzdn6O4i5dqAOV4Fcj2ygwAP_QswtRJ14ZHJHGitzf08SmRylqDG_nCql0aGgk Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:30:27.356503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}] Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 4db0180026ae46838dcccf820278e06c Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '87549584-dbe0-4929-a7f1-8ed6b9347b23'} Aug 03 09:30:27.358275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. (HTTP 404) (Request-ID: req-a50d54c1-b61a-40b2-8a0f-32b1da117fe1) Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.359859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:27.362228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 09:30:27.364090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.366991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.371069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9ebdd1a-1e25-4140-a2b7-ea5e59b4e45b tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Returning 404 to user: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:30:27.372171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f9ebdd1a-1e25-4140-a2b7-ea5e59b4e45b tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 404 len: 109 microversion: 2.1 time: 0.101645 Aug 03 09:30:27.385238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 9/18] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:27 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:30:27.389885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-049e1c50-51a8-432e-9b36-86e3406fc852 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa383a0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:27.452955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-049e1c50-51a8-432e-9b36-86e3406fc852 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] HTTP exception thrown: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-049e1c50-51a8-432e-9b36-86e3406fc852 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Request method failure captured: Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 HTTP/1.1 Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kAk4FThXygyvV-hYEpdC5AHEYAfDUfgrLUiKSljx2kvtUd2KRSUNncMpipMROIUcWmCg1C5Qv2TiJiUQpAHVEGa9N9BQFRqpF3VdUQDPxdmMJ98aUzdn6O4i5dqAOV4Fcj2ygwAP_QswtRJ14ZHJHGitzf08SmRylqDG_nCql0aGgk Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:30:27.461248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}] Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 4db0180026ae46838dcccf820278e06c Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '87549584-dbe0-4929-a7f1-8ed6b9347b23'} Aug 03 09:30:27.462760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. (HTTP 404) (Request-ID: req-542fcf94-e530-47c2-9377-ef0efaae3c01) Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.463458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 09:30:27.464745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 09:30:27.466000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.467358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.470874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-049e1c50-51a8-432e-9b36-86e3406fc852 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Returning 404 to user: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:30:27.472665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-049e1c50-51a8-432e-9b36-86e3406fc852 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 404 len: 109 microversion: 2.1 time: 0.086744 Aug 03 09:30:27.474721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 10/19] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:30:27 2022] DELETE /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:30:27.492141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82a1ef5c-e1f4-4d65-a3ac-9bad3696a2a1 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Calling method '.version_select at 0x7fb99aa55c10>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:27.561418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-82a1ef5c-e1f4-4d65-a3ac-9bad3696a2a1 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] HTTP exception thrown: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82a1ef5c-e1f4-4d65-a3ac-9bad3696a2a1 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Request method failure captured: Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 HTTP/1.1 Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kAk4FThXygyvV-hYEpdC5AHEYAfDUfgrLUiKSljx2kvtUd2KRSUNncMpipMROIUcWmCg1C5Qv2TiJiUQpAHVEGa9N9BQFRqpF3VdUQDPxdmMJ98aUzdn6O4i5dqAOV4Fcj2ygwAP_QswtRJ14ZHJHGitzf08SmRylqDG_nCql0aGgk Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:30:27.564096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_fa7447c8489845b2a3d674139146f2fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/fa7447c8489845b2a3d674139146f2fb"}]}] Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: fa7447c8489845b2a3d674139146f2fb Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-978177445 Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 4db0180026ae46838dcccf820278e06c Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotsTestJSON-978177445-project Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '87549584-dbe0-4929-a7f1-8ed6b9347b23'} Aug 03 09:30:27.565247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. (HTTP 404) (Request-ID: req-7756d375-ec72-450c-8106-4c83d22aa688) Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.565951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 09:30:27.567011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 09:30:27.568861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. Aug 03 09:30:27.569734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:30:27.572574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82a1ef5c-e1f4-4d65-a3ac-9bad3696a2a1 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] Returning 404 to user: Volume 87549584-dbe0-4929-a7f1-8ed6b9347b23 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:30:27.575805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-82a1ef5c-e1f4-4d65-a3ac-9bad3696a2a1 tempest-VolumesSnapshotsTestJSON-978177445 tempest-VolumesSnapshotsTestJSON-978177445-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23" status: 404 len: 109 microversion: 2.1 time: 0.095595 Aug 03 09:30:27.582857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 10/20] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 09:30:27 2022] GET /compute/v2.1/os-volumes/87549584-dbe0-4929-a7f1-8ed6b9347b23 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:30:32.203909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce54d0de-2848-4990-a45b-9e8455f629f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'create', calling method: .version_select at 0x7fb99aa0bc10>, body: {"keypair": {"name": "tempest-keypair-1604167293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+K6kiDDMtbeV6ZS33Oo4l6ibfffMBuORiHydprRNFYcFe/bkzE/KGCmCNevHwrWZLmbkDE+CCrS7VTQFMgT3W26WYziuZfRK4AYNjnLihBbpp3BbTQDI5ltlrPAgBWhA=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:32.223517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-ce54d0de-2848-4990-a45b-9e8455f629f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for project 3a4f922101d8435d977a4df9843338e8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:32.229756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-ce54d0de-2848-4990-a45b-9e8455f629f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for user 317467d6f856435f8f7eee33eb92c6e3 and project 3a4f922101d8435d977a4df9843338e8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:32.270286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce54d0de-2848-4990-a45b-9e8455f629f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.026854 Aug 03 09:30:32.278199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 11/21] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 3 09:30:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 09:30:34.207383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2038938492", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7547450-fb93-4015-9252-8a4639c271bc"}], "security_groups": [{"name": "tempest-securitygroup--1915490174"}], "key_name": "tempest-keypair-1655844225", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:34.996932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] validate_networks() for [('f7547450-fb93-4015-9252-8a4639c271bc', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:37.480129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ec31ca14-18f0-42fe-9506-8fad9424baec tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: .version_select at 0x7fb99a1ad5e0>, body: {"keypair": {"name": "tempest-keypair-1264816701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw1f7v0TNOudIKGlY30XgwsLNO37PnGCLGeWccslrGV3j/eRWouMDiUc9LfnvSQk68bRYPUOwLpaQWQbLGUz064EpjoYDoh8dvGvN+Zi698J3NjWiKWC6OYpgwgFVYXbw=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:37.534109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-ec31ca14-18f0-42fe-9506-8fad9424baec tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:37.562882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-ec31ca14-18f0-42fe-9506-8fad9424baec tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:37.666785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ec31ca14-18f0-42fe-9506-8fad9424baec tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699485 Aug 03 09:30:37.667875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 12/22] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:30:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:30:39.204430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1149394377", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "networks": [{"uuid": "46906383-6053-4191-a2cb-c95eac01ac9a"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:39.495587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] validate_networks() for [('46906383-6053-4191-a2cb-c95eac01ac9a', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:40.085612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:40.086693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:40.087390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:40.087944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:40.088524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:40.128192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:40.133736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:40.136024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:40.139084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:40.253577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for project 0e293737b69a41e79fdcdbb99baca498. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:40.275310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for user 29203ff4c61c48fd940e6ac6c51e5fea and project 0e293737b69a41e79fdcdbb99baca498. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:40.311556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:40.317109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:40.549559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e80957a9-bac8-41b3-946a-fd0cc4922b81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.352092 Aug 03 09:30:40.551131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 11/23] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:30:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 6370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:30:41.224313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-589211460", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:41.462324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] validate_networks() for [('eb1b7df0-9151-4a05-b278-939fa226e4f3', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:42.997875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:42.998314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:42.998731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:42.999144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:42.999659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:43.018789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:43.019248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:43.022562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:43.023020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:43.110235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Getting quotas for project ad698ec9040442478293005d3e8e1cb3. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:43.117459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:43.117932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:43.118333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:43.118736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:43.119153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:43.122656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Getting quotas for user ca0fa48bca5d4ee4a8e5a5ad4253e570 and project ad698ec9040442478293005d3e8e1cb3. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:43.155218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:43.155704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:43.159180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:43.163336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:43.163857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:43.169370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:43.258408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:43.269814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for user f366a30f465b4dbea0dfa9a8e5f0a15c and project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:43.306523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:43.311564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:43.408357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9650d504-34a9-4ac8-8def-ac900d0c6e8b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.700455 Aug 03 09:30:43.409396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 13/24] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:30:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:30:43.418980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b8f3805d-c371-42b2-999b-f42779df4a41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:43.422065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8f3805d-c371-42b2-999b-f42779df4a41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:43.448794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-596e588e-d31a-41ec-9f2d-b21f51d6ba42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.894812 Aug 03 09:30:43.450016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 12/25] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:30:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:30:43.463812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-695311014", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f361acc-01c0-4f7c-89aa-cea2be3ec17f"}], "security_groups": [{"name": "tempest-securitygroup--1365805167"}], "key_name": "tempest-keypair-1604167293", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:43.707744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8f3805d-c371-42b2-999b-f42779df4a41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:43.801338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b8f3805d-c371-42b2-999b-f42779df4a41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1238 microversion: 2.1 time: 0.388144 Aug 03 09:30:43.804550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 14/26] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1238 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:43.814204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ef915c8-4511-43ca-a4aa-59e768616cb4 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:43.817064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ef915c8-4511-43ca-a4aa-59e768616cb4 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:43.920992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ef915c8-4511-43ca-a4aa-59e768616cb4 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:43.929861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ef915c8-4511-43ca-a4aa-59e768616cb4 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1215 microversion: 2.1 time: 0.124135 Aug 03 09:30:43.948699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 15/27] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:43 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:43.956298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00020fd2-5dcc-4197-9a1f-a3f00432568c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:43.957659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00020fd2-5dcc-4197-9a1f-a3f00432568c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:44.129293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] validate_networks() for [('2f361acc-01c0-4f7c-89aa-cea2be3ec17f', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:44.142218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00020fd2-5dcc-4197-9a1f-a3f00432568c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:44.152539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00020fd2-5dcc-4197-9a1f-a3f00432568c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1221 microversion: 2.1 time: 0.202426 Aug 03 09:30:44.160206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 16/28] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:43 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1221 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:44.502741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1685403528", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:44.639442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] validate_networks() for [('eb1b7df0-9151-4a05-b278-939fa226e4f3', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:45.893526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:45.893991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:45.894298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:45.894707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:45.895111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:45.919528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:45.919974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:45.923627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:45.923627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:45.995206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for project 3a4f922101d8435d977a4df9843338e8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:46.007117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for user 317467d6f856435f8f7eee33eb92c6e3 and project 3a4f922101d8435d977a4df9843338e8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:46.052425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:46.054181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:46.195398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87e4ac2a-4e66-4a8b-b1d2-10b09fd49cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.744136 Aug 03 09:30:46.196036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 13/29] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 3 09:30:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 03 09:30:46.201996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:46.211274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:46.249714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.261549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:46.262877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.263491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:46.330873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:46.331360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:46.331834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:46.332240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:46.332671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:46.363712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.364210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:46.374642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.375558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:46.422982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:46.433310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for user f366a30f465b4dbea0dfa9a8e5f0a15c and project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:46.543234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:46.560496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:46.779453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f3e5744-474c-405f-9228-54d3364d7462 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.290990 Aug 03 09:30:46.784967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 17/30] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:30:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:30:46.800963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:46.819170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:46.855991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.858813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:46.864053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:46.866105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:47.222155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:47.283787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b97e7314-3e16-4abd-aae4-7c4da62a07bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1290 microversion: 2.1 time: 1.081206 Aug 03 09:30:47.287045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1290 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:47.313594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1098055173", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b08b9e0-74e3-4321-8eca-779df9e19114"}], "security_groups": [{"name": "tempest-securitygroup--2125187213"}], "key_name": "tempest-keypair-1264816701", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:30:47.838328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] validate_networks() for [('1b08b9e0-74e3-4321-8eca-779df9e19114', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:30:47.855890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:47.897140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-657cb2b8-c62e-4b1b-ba62-4cbf6532548c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1267 microversion: 2.1 time: 1.107271 Aug 03 09:30:47.897890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 18/32] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:46 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1267 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:47.925819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:47.927303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:47.961187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:47.962165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:47.965725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:47.966690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:48.675270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:48.685518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:48.695158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:48.696943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1704e55c-b19d-4790-9c3a-8eb28171cc20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1285 microversion: 2.20 time: 0.777822 Aug 03 09:30:48.701755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 19/33] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1285 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:30:48.717123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:48.717747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:48.732065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:48.732513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:48.733788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:48.734247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.076198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:49.087075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cecb890-d070-4163-8c2c-689aa71e33cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1218 microversion: 2.1 time: 0.384055 Aug 03 09:30:49.091377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 20/34] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:48 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1218 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:49.096267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:49.107567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:49.128387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.128860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.129648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.130122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.247585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:30:49.248785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:30:49.249596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:30:49.250300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:30:49.250883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:30:49.281445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.282403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.285356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.290614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.418969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:30:49.443510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:30:49.514561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:30:49.524608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:30:49.703512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72cef738-5c03-41f0-991f-928ba60b1b44 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.409531 Aug 03 09:30:49.707138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 15/35] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:30:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 2418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:30:49.737939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:49.739877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:49.775942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.779564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.783980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:49.785779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:49.990266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.002982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73ef38aa-eb60-44f6-b03f-09c37134187f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1296 microversion: 2.1 time: 0.910163 Aug 03 09:30:50.005927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 21/36] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1296 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:50.018122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7215c779-ba56-4eec-b04e-7be81bae62c2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:50.021498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7215c779-ba56-4eec-b04e-7be81bae62c2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:50.274993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.284047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce177da9-6f1c-4fc7-b629-12aa1a156044 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1273 microversion: 2.1 time: 0.574837 Aug 03 09:30:50.293625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 16/37] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:49 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1273 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:50.310494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:50.311274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:50.350142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:50.350142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:50.352593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:50.353608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:50.459875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7215c779-ba56-4eec-b04e-7be81bae62c2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.478975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7215c779-ba56-4eec-b04e-7be81bae62c2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1242 microversion: 2.1 time: 0.471698 Aug 03 09:30:50.479886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 22/38] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:50 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1242 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:50.493522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:50.494126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:50.513879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:50.514341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:50.515127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:50.515688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:50.575416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.597005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.599873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.601503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32a513fa-d883-4dff-9582-49bf7ea563f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1339 microversion: 2.20 time: 0.306360 Aug 03 09:30:50.602497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 17/39] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:30:50.677796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:50.686988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7638ff3-129d-4bd1-9806-b73e0a33b9ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1280 microversion: 2.1 time: 0.205935 Aug 03 09:30:50.697730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:50 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:51.031760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:51.032624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:51.056876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.063370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:51.068477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.069378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:51.321290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:51.322075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:51.343725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.346011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:51.348668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.351603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:51.822485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:51.848004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4b521e9-6f3e-429e-8869-b4ecc9801165 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1273 microversion: 2.1 time: 0.532161 Aug 03 09:30:51.849021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 24/41] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:51 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1273 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:51.859671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:51.860302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:51.902349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.919337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:51.924698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:51.925227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.267440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:52.290204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d5ac7df-6542-4f90-bcb0-1a8ed4a8902d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1294 microversion: 2.1 time: 0.439799 Aug 03 09:30:52.290824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 25/42] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:51 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1294 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:52.327181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:52.330226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:52.356267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:52.381118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.381751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.382594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.387373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.470133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:52.494039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07360ecd-e3f2-49e2-99a6-90b665fe7802 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1296 microversion: 2.1 time: 1.466962 Aug 03 09:30:52.497153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 18/43] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1296 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:52.514495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:52.516392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:52.532957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.534852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.545949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.546924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.826268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:52.835827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:52.843833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:52.845467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-af7cdefa-4348-4acf-869d-1546b62e206c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1339 microversion: 2.20 time: 0.543052 Aug 03 09:30:52.850688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 26/44] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1339 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:30:52.876604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:52.877849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:52.893831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.894507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:52.895626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:52.896319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.144457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:53.163482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1924d1b9-60fd-492b-840c-c7f39d239935 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1273 microversion: 2.1 time: 0.291553 Aug 03 09:30:53.178876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 27/45] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:52 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:30:53.321187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:53.323060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:53.341700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:53.369631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-50faad79-083f-4c6a-acf5-366c24ed4c23 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1280 microversion: 2.1 time: 0.867891 Aug 03 09:30:53.374107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 19/46] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:52 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1280 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:53.376841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.381611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.384013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.387677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.522880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:53.523547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:53.541854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.543006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.546518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.548955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.788973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:53.809790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-91eefc9e-ea31-421a-b097-f94e48b0e237 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1300 microversion: 2.1 time: 0.498370 Aug 03 09:30:53.819357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 28/47] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:53 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1300 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:53.892403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:53.895426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:53.922136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.925341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:53.928082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:53.931249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:54.191006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:54.230138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:54.257445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:54.259536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8537150e-7c7b-464d-a96e-cac5218501a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1339 microversion: 2.20 time: 0.378114 Aug 03 09:30:54.296133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 29/48] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1339 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:30:54.313817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:54.315578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:54.342764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:54.347204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:54.352061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:54.353065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:55.544025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:55.553481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-75323972-4eb2-4b01-bc44-8ef7313a9bd1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 2.036474 Aug 03 09:30:55.574521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 20/49] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:30:55.586957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:55.587560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:55.625158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:55.625614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:55.631864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:55.632310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:55.954485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:55.972532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c0e9ad2-99c4-4521-95cd-6162b5dadf71 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 1.674901 Aug 03 09:30:55.977878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 30/50] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:54 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:55.995325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:55.995966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:56.023739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:56.024490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:56.025515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:56.026543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:56.400974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:56.590783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:56.609473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f64b754-94c7-481e-81fe-dd42f613ba5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1300 microversion: 2.1 time: 0.630203 Aug 03 09:30:56.614772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 31/51] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:55 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1300 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:56.635102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:56.635659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:56.669097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:56.672227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:56.675374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:56.678529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:57.872451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:57.896387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:57.898197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:57.905379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-609709b7-7c07-4f18-9500-f7b00f51c761 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 1.283422 Aug 03 09:30:57.906135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 32/52] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:30:57.921089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:57.924150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:57.938569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:57.941202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:57.942747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:57.945653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:58.302889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:58.319960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ec77e99-3712-4b59-898e-1874e136e7d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 2.744026 Aug 03 09:30:58.321130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 21/53] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:55 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:58.338265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:58.341701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:58.345955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=12 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:58.364294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:58.364742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:58.365650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:58.366092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:58.971528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:58.983659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df168acc-0375-4375-8e4d-5dd92a6fc59e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 1.075190 Aug 03 09:30:59.006546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 33/54] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:59.018295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:59.022044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:59.039237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:59.041800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:59.043144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:59.045541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:59.349692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=8 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:59.444481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:59.457162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:59.477165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a83aea9a-e200-479e-b5c3-7e94e4369659 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1300 microversion: 2.1 time: 0.468022 Aug 03 09:30:59.478459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 34/55] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:59 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1300 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:59.493597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=24 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:30:59.504593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:59.506308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:30:59.514190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:59.514834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:59.515772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:30:59.516569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:30:59.960993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:30:59.971565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9cdcae23-c137-47d0-a643-c6c6875ccc66 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 1.648970 Aug 03 09:30:59.975537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 22/56] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:58 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:30:59.988895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:30:59.989927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:00.017056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:00.033085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:00.039549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:00.042101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:00.465055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=32 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:00.673851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:00.721259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:00.732389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:00.737969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77fcfc7d-0320-4fde-8d8e-e5c0d3ca2ece tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 1.257753 Aug 03 09:31:00.739738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 35/57] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:30:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:00.763881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:00.765449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:00.783950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:00.784787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:00.788647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:00.789856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:01.214704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:01.223433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d4888ba8-c904-4fec-9dc1-ecc6f8824287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 1.246630 Aug 03 09:31:01.224436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 23/58] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:30:59 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:01.244588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:01.258451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:01.289710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:01.290614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:01.291565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:01.292181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:01.818437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:01.831476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b61e772-9fa9-46c3-bbc2-4a10459d2186 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 1.088730 Aug 03 09:31:01.836643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 36/59] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:02.219748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-56f09fdb-23ce-4f73-9b6b-05418e06c31d req-c12e4a26-5b18-43dd-a94d-4a498dc3bea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc1c84c-9403-45ab-987b-c0e33d70b89c", "tag": "5bef86f0-0366-4357-ae69-095f33a29c62"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:02.311771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-56f09fdb-23ce-4f73-9b6b-05418e06c31d req-c12e4a26-5b18-43dd-a94d-4a498dc3bea6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.319074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-56f09fdb-23ce-4f73-9b6b-05418e06c31d req-c12e4a26-5b18-43dd-a94d-4a498dc3bea6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.501338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-56f09fdb-23ce-4f73-9b6b-05418e06c31d req-c12e4a26-5b18-43dd-a94d-4a498dc3bea6 service nova] Creating event network-changed:5bef86f0-0366-4357-ae69-095f33a29c62 for instance fbc1c84c-9403-45ab-987b-c0e33d70b89c on hv-cinder-84456 Aug 03 09:31:02.501971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-56f09fdb-23ce-4f73-9b6b-05418e06c31d req-c12e4a26-5b18-43dd-a94d-4a498dc3bea6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 09:31:02.509289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.512415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.532536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.534960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.636603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.compute.rpcapi [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 09:31:02.642045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] Releasing lock "compute-rpcapi-router" {{(pid=117928) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 09:31:02.706487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a1972da7-5fe6-4e75-888c-c98b5d1be665 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.868265 Aug 03 09:31:02.707428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 37/60] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:02.735717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:02.741725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:02.757485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.758774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.760237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.761078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.920482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:02.929941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23350ac5-3f8d-44a9-96c1-d12e8c9d9239 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 1.691804 Aug 03 09:31:02.930627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 24/61] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:01 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:02.936155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:02.936894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:02.944781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.945582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:02.946603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:02.947246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.021445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.031375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c9afb31-f05f-4983-8a9b-124504881349 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.321659 Aug 03 09:31:03.032090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 38/62] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:02 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:03.044550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:03.046933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:03.056479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.059451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.060969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.061716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.407432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.421896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f0bec3c-a5dc-4f9a-97b4-f1658a41e3b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.383766 Aug 03 09:31:03.422495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 39/63] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:03 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:03.433640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:03.434262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:03.441099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.441720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.442731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.443342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.535626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.550970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.555339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.557533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fc691625-374f-41de-afba-a5c7e588a978 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.625400 Aug 03 09:31:03.559175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 25/64] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:03.721694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:03.735326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-736d6beb-1e6e-4a29-982e-fcdee4d34c95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.310529 Aug 03 09:31:03.737438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 40/65] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:03.792626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-0c6622de-b81a-4e12-8c13-ea68871e2e63 req-a5d84283-9006-46d0-8260-cbf309e2d15a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "708ec0aa-3818-45fd-9be1-1832b91abdbc", "tag": "a6eb1086-96d4-48f1-ba49-b2cdf68828f9"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:03.809625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0c6622de-b81a-4e12-8c13-ea68871e2e63 req-a5d84283-9006-46d0-8260-cbf309e2d15a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.810996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0c6622de-b81a-4e12-8c13-ea68871e2e63 req-a5d84283-9006-46d0-8260-cbf309e2d15a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.833723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-0c6622de-b81a-4e12-8c13-ea68871e2e63 req-a5d84283-9006-46d0-8260-cbf309e2d15a service nova] Creating event network-changed:a6eb1086-96d4-48f1-ba49-b2cdf68828f9 for instance 708ec0aa-3818-45fd-9be1-1832b91abdbc on hv-cinder-84456 Aug 03 09:31:03.834592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-0c6622de-b81a-4e12-8c13-ea68871e2e63 req-a5d84283-9006-46d0-8260-cbf309e2d15a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 03 09:31:03.836180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.836673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.837565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.838052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.847589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.compute.rpcapi [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 03 09:31:03.849128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] Releasing lock "compute-rpcapi-router" {{(pid=117929) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 03 09:31:03.866820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c2dcf21-1d3d-4434-ad0f-e279262ea0ff None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.305934 Aug 03 09:31:03.867507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 26/66] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:03.951461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:03.952739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:03.964440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.965977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:03.967602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:03.968346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.059230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:04.061198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:04.083409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.084340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.087218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.088070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.170762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.181471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f04beef7-0259-403f-b187-a100555a6905 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.234773 Aug 03 09:31:04.183112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 41/67] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:03 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:04.339097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.348352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2f5434d-41d0-45be-934e-0d486ea44415 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.296455 Aug 03 09:31:04.350378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 27/68] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:04 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:04.444170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:04.445104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:04.451843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.452293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.453152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.453590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.587238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:04.588016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:04.597596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.598482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.599405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.600018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.632228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.640372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-243ae3a6-0e6a-4d08-bbdc-9e8d00f411b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.200939 Aug 03 09:31:04.654599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 42/69] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:04 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:04.762079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:04.762756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:04.770199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.770765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.771532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.771965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.792141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.802475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.804796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.806635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-82710309-6be3-433a-a826-af4ea9c2982c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.224872 Aug 03 09:31:04.807492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 28/70] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:04.814324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-20377edb-5d44-4323-aa29-c81b482db1a3 req-d764f340-1a56-4d27-8a03-21c744c26e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a1a022-8f7e-4e28-9a07-49184dfcfcfd", "tag": "11fbb955-cb55-401d-b52c-df2706864e50"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:04.839217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-20377edb-5d44-4323-aa29-c81b482db1a3 req-d764f340-1a56-4d27-8a03-21c744c26e4b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:04.839943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-20377edb-5d44-4323-aa29-c81b482db1a3 req-d764f340-1a56-4d27-8a03-21c744c26e4b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:04.853103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-20377edb-5d44-4323-aa29-c81b482db1a3 req-d764f340-1a56-4d27-8a03-21c744c26e4b service nova] Creating event network-changed:11fbb955-cb55-401d-b52c-df2706864e50 for instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd on hv-cinder-84456 Aug 03 09:31:04.859332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-20377edb-5d44-4323-aa29-c81b482db1a3 req-d764f340-1a56-4d27-8a03-21c744c26e4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050478 Aug 03 09:31:04.860560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 29/71] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:04.961444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:04.969582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73233f4e-3531-4f98-87c0-d53155800fed tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.212089 Aug 03 09:31:04.970297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 43/72] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:05.206264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:05.206885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:05.214640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:05.215399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:05.216342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:05.216997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:05.384414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:05.385977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:05.393177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:05.394152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:05.395146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:05.396621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.050117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.064261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe1012d0-91a1-47e7-81d4-96ed81664a51 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.688376 Aug 03 09:31:06.078608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 44/73] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:05 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:06.096833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:06.096833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:06.118109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.133474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c44bc4f-4d2c-4e95-92cd-15d066cf0415 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.931646 Aug 03 09:31:06.137523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 30/74] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:05 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:06.147986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.148621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.154402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.160221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.171396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:06.173289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:06.189663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.197189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.200402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.201106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.228689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:06.773994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.789616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f774c53-3d52-4163-b09a-a6c7e900f426 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.704931 Aug 03 09:31:06.791240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 45/75] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:06 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:06.798960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}, {"name": "network-changed", "server_uuid": "b3166329-2bc2-4aea-983b-a8e05ff43d38", "tag": "779880c1-0e74-44a1-b797-d284789bbdc6"}, {"name": "network-changed", "server_uuid": "c3dcc900-18b4-4f36-911d-e61fc4a9cc58", "tag": "a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:06.816783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.817632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.837202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Creating event network-changed:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:31:06.837702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Creating event network-changed:779880c1-0e74-44a1-b797-d284789bbdc6 for instance b3166329-2bc2-4aea-983b-a8e05ff43d38 on hv-cinder-84456 Aug 03 09:31:06.838191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] Creating event network-changed:a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f for instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 on hv-cinder-84456 Aug 03 09:31:06.850143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-ec702712-0731-4dac-a155-b7ecaef386b7 req-da5b28cc-226e-47a5-a840-e1e9f779471b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.056992 Aug 03 09:31:06.851055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 46/76] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:06.856792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:06.857523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:06.866229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.866747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.867855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:06.868283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:06.904443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.929923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.932922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:06.934369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8494d891-91f9-46e1-bce3-374e30027d7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.793552 Aug 03 09:31:06.935155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 31/77] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:07.054463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:07.063789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c4b97df9-74ff-4e51-9090-be88c37e9597 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.211215 Aug 03 09:31:07.064873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 47/78] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:07.087768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:07.088394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:07.095139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.095599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.096376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.096840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.159640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:07.160610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:07.171470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.172106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.174124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.174924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.305817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:07.318430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0479a2c6-0906-494e-a725-d59a62d93c8e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.234422 Aug 03 09:31:07.320673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 32/79] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:07 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:07.354919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:07.363096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be6af9ef-85e3-4429-9b27-fa087eef2d6d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.207416 Aug 03 09:31:07.363863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 48/80] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:07 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:07.811929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:07.812537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:07.819915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.820355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.821143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.960727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:07.961381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:07.961830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:07.967640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.968085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.972072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:07.972072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:07.975355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7bef425-8bf7-493f-a70d-3ca40b32a968 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.167377 Aug 03 09:31:07.989774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 33/81] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:07 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:08.085857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:08.086751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:08.094284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.095014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.096098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.096536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.116742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.125842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.127343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.128489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5107cf29-fd3a-4e06-9729-17edfe01f45d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.172558 Aug 03 09:31:08.129431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 49/82] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:08.254233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.262390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-102bf6cd-83f6-4d93-934b-118255f4c775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.181711 Aug 03 09:31:08.262967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 34/83] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:08.342598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:08.343218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:08.352260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.352797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.353684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.354114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.387202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:08.387812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:08.394327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.395195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.396665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:08.397281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:08.548516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.558387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb62130d-5346-48c1-afb5-603731216809 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.174888 Aug 03 09:31:08.559521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 35/84] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:08 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:08.587937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:08.595694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aa2e76e2-3f12-487e-a05b-b3feaf80a4ef tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.257059 Aug 03 09:31:08.596273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 50/85] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:08 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:08.995810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:08.996626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:09.003137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.003861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.005488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.006289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.146323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.151959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:09.152563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:09.155082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a88807dc-9c83-476d-adc8-061cee371637 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.163208 Aug 03 09:31:09.155776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 36/86] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:08 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:09.158871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.159355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.160109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.160598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.283553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:09.284258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:09.290412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.291138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.291894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.292510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.349978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.374269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.376035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.377258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-27276b2d-8771-486b-bd9b-582de19a9a10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.229067 Aug 03 09:31:09.389140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 51/87] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:09.440245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.449244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0bd68e8-e1c5-492d-b1f1-943505f65d5f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.169498 Aug 03 09:31:09.449820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 37/88] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:09.579637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:09.580348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:09.587081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.587782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.588990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.589731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.617855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:09.619006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:09.619624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:09.627638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.628115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.628895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:09.629343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:09.759034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.774517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a82a45c7-c9cd-4c7d-817f-65fd6551a80a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.198646 Aug 03 09:31:09.775714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 52/89] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:09 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:09.969904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:09.978734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cffe7af9-486b-4c8c-aaca-66642409740c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.364315 Aug 03 09:31:09.979722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 38/90] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:09 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:10.177950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:10.178536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:10.185559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.186006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.186778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.187676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.343407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.353348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-438d0ba2-09c3-4ad8-a802-f95b3bccd9d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.179828 Aug 03 09:31:10.365501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 53/91] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:10 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:10.402513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:10.403307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:10.410097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.410536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.411343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.411766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.470873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:10.471480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:10.478043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.478488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.479420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.479952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.598137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.608459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.610500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.612047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-203ed4f5-a660-4de6-a13a-91826c6b0355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.216424 Aug 03 09:31:10.620264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 39/92] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:10.634108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.642783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e50c4d6d-5ad8-44a5-b82f-baa13af03e2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.176192 Aug 03 09:31:10.643444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 54/93] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:10.796003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:10.796621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:10.802939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.803621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.804391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:10.805031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:10.964913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:10.973749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e506f6b-a8b6-48c6-aa4f-bae383bc60ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.181699 Aug 03 09:31:10.974592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 40/94] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:10 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:11.001888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:11.002578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:11.009489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.009998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.010822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.011360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.190194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.209423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2373077a-8bc4-4d01-a653-af553051d54b tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.211127 Aug 03 09:31:11.210246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 55/95] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:10 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:11.376299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:11.377153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:11.383265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.383712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.384602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.384936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.535786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.544683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ac83ccfb-7bdd-4202-af5b-a65d6f6c28dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.172514 Aug 03 09:31:11.545262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 41/96] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:11 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:11.635017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:11.635628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:11.641524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.641967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.642722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.643148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.665439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:11.667416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:11.674491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.675343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.676286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:11.677212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:11.819816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.827878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.829572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7517a3a3-a11b-4232-bd6c-0241087fcf42 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.169940 Aug 03 09:31:11.830372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 42/97] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:11.837394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.838897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:11.839996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cf25774e-1424-4c6f-bd52-3247982f41df tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.208838 Aug 03 09:31:11.840543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 56/98] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:11.995550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:11.996157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:12.002142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.002590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.003348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.003779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.165819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:12.173820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1502e718-c9d1-4635-93cb-5e312dbadd83 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.182998 Aug 03 09:31:12.174514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 43/99] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:11 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:12.230542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:12.231166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:12.237270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.237800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.238632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.239721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.465319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:12.472629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d603b62-ac88-482f-a672-715938bb889c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.246153 Aug 03 09:31:12.473334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 57/100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:12 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:12.565350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:12.566169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:12.572742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.573213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.573981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.574409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.733855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:12.742885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01537a28-2717-4687-bf0c-d523f5652a92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.181185 Aug 03 09:31:12.743591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 44/101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:12 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:12.851704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:12.852305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:12.854354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:12.861819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.862271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.862908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:12.863041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.863471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.863575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:12.869619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.870055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:12.870811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:12.871238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.011939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.020872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bdf2d478-9d9e-4e38-b28a-5281999b595a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.173102 Aug 03 09:31:13.033959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 58/102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:13.034300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.034300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.034489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.034653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3fe8f148-9238-4462-984d-f63651e5a3f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.175578 Aug 03 09:31:13.035396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 45/103] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:13.195178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:13.196619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:13.202936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.203314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.204179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.204614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.343041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.350964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-243d3d4d-d6ad-4cc5-a7e0-8c3baf9d0d23 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.160613 Aug 03 09:31:13.351530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 59/104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:13 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:13.495656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:13.496292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:13.502229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.502665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.503407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.503835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.633158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.640476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d890776d-f20c-475c-9e69-dd804ab021c3 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.148610 Aug 03 09:31:13.641070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 46/105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:13 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:13.764226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:13.765040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:13.772229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.772670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.773460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:13.773888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:13.914396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:13.922059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bbc86308-576e-4213-b59b-494daef33597 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.161600 Aug 03 09:31:13.922696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 60/106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:13 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:14.042798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:14.043548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:14.045526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:14.053012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.053693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.055677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.056257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.059149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:14.059858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:14.072140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.074138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.075096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.076252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.288238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.292997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:14.298628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e8933b4-435a-4be5-a542-df84ae8a5d85 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.259613 Aug 03 09:31:14.300064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 47/107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:14.307031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.315788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.319750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.321147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5df6bd43-146c-43ee-88c9-9ecaf9e54fb2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.267473 Aug 03 09:31:14.329777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 61/108] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:14.372512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:14.373144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:14.375900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-86e9a556-c35e-4279-b97a-cebc14ea9a6e req-caf4584c-331e-4b87-93df-8efd3ee53149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc1c84c-9403-45ab-987b-c0e33d70b89c", "name": "network-vif-plugged", "status": "completed", "tag": "5bef86f0-0366-4357-ae69-095f33a29c62"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:14.387746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.388046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-86e9a556-c35e-4279-b97a-cebc14ea9a6e req-caf4584c-331e-4b87-93df-8efd3ee53149 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.388984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-86e9a556-c35e-4279-b97a-cebc14ea9a6e req-caf4584c-331e-4b87-93df-8efd3ee53149 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.389734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.391998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.394468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.414880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-86e9a556-c35e-4279-b97a-cebc14ea9a6e req-caf4584c-331e-4b87-93df-8efd3ee53149 service nova] Creating event network-vif-plugged:5bef86f0-0366-4357-ae69-095f33a29c62 for instance fbc1c84c-9403-45ab-987b-c0e33d70b89c on hv-cinder-84456 Aug 03 09:31:14.434009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-86e9a556-c35e-4279-b97a-cebc14ea9a6e req-caf4584c-331e-4b87-93df-8efd3ee53149 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132199 Aug 03 09:31:14.434998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 48/109] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:14.544835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.553064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d0a3d8c-b927-4384-8e11-329f7a1aeaee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.184290 Aug 03 09:31:14.553649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 62/110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:14 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:14.671180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:14.671180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:14.671472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.671667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.672425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.672913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.805370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:14.812918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4b087ac1-dbc7-4f4d-a41c-5dfcc650e05c tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.154723 Aug 03 09:31:14.813490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 49/111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:14 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:14.945083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:14.945683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:14.951815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.952250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:14.953053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:14.953488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.092329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:15.100768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dda734ae-22e9-4fbb-bcc2-91cf6674f4e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.160707 Aug 03 09:31:15.101365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 63/112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:14 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:15.323817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:15.325468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:15.333266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.333822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.334497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.334932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.346326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:15.347784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:15.358866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.378892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.380793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.382866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.724754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:15.737528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:15.742153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:15.745445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a051944-ca0b-4f9a-84c4-d0f3d01ddc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.405809 Aug 03 09:31:15.746024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 64/113] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:15.757109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:15.757833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:15.769986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.771233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.772030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:15.772662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:15.937058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:15.953464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e27c44c9-95f5-4ade-a520-20036f6d7e38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.636408 Aug 03 09:31:15.972743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 50/114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:15.972743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:15.977435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:16.025156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.025603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.026383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.026805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.141290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.154221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45d58a52-bb70-487c-aeab-7ae97672cd42 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.403839 Aug 03 09:31:16.167388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 65/115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:15 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:16.187949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:16.191453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:16.210221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.210783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.211822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.213323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.502456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.509531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.511277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d69efc53-831c-4ffe-8ce5-bf98eedc3dbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.336218 Aug 03 09:31:16.512048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 66/116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:16 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:16.517955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-35d64d8f-b5fb-4d4f-a835-0c178194ef80 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.553225 Aug 03 09:31:16.518691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 51/117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:15 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:16.529809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-3a07c39f-be14-48de-a097-f0d49a6beed4 req-96f75e1b-005f-445e-bd22-d79c5bea63ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a1a022-8f7e-4e28-9a07-49184dfcfcfd", "name": "network-vif-plugged", "status": "completed", "tag": "11fbb955-cb55-401d-b52c-df2706864e50"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:16.540036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3a07c39f-be14-48de-a097-f0d49a6beed4 req-96f75e1b-005f-445e-bd22-d79c5bea63ed service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.540484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3a07c39f-be14-48de-a097-f0d49a6beed4 req-96f75e1b-005f-445e-bd22-d79c5bea63ed service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.553115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-3a07c39f-be14-48de-a097-f0d49a6beed4 req-96f75e1b-005f-445e-bd22-d79c5bea63ed service nova] Creating event network-vif-plugged:11fbb955-cb55-401d-b52c-df2706864e50 for instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd on hv-cinder-84456 Aug 03 09:31:16.558056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-3a07c39f-be14-48de-a097-f0d49a6beed4 req-96f75e1b-005f-445e-bd22-d79c5bea63ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043362 Aug 03 09:31:16.558661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 67/118] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:16.771424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:16.772493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:16.780265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.781389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.782473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.783938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.946782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.954801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.956634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:16.958217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f75f25b-5b5d-4433-8756-676b37f028e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.191344 Aug 03 09:31:16.958784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 52/119] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:16.978446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:16.979160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:16.985364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.985801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:16.986551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:16.986976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.180486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:17.181371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:17.188448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.189329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.190173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.190661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.338186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:17.338576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:17.349589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-64f57575-c0e2-4af9-b6cb-d1c7e66232d6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.172717 Aug 03 09:31:17.350771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 53/120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:17 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:17.359362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48993698-10fc-43b8-a79c-da2c10980c3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.383071 Aug 03 09:31:17.363347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 68/121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:17.532664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:17.533320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:17.542210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.542549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:17.542975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.543299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:17.543403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.543834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.552974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.553608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.554663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.555323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.749244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:17.761138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-22af7f6f-ee50-447a-b68c-5097f05e812e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.231704 Aug 03 09:31:17.762346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 54/122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:17 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:17.819993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:17.823460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:17.828679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc4b32cd-6a3e-430f-91ed-551e3d462073 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.290650 Aug 03 09:31:17.829395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 69/123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:17 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:17.980900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:17.981623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:17.987658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.988111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:17.988898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:17.989332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.116562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.124524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.126068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.127156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7590c0c-fed8-4927-b44c-cdc7c3378051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.150251 Aug 03 09:31:18.127711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 55/124] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:18.371633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:18.372230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:18.378272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.378718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.379471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.380517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.383539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:18.384149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:18.389977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.390409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.391162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.391584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.521237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.529671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a10cc2d8-45e9-4943-8abb-8402e1d08998 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.162078 Aug 03 09:31:18.530242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 70/125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:18 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:18.541925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.549385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-501e6f64-f42c-4d7d-b2bf-ab5afb985e0e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.171029 Aug 03 09:31:18.549970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 56/126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:18.785066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:18.785659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:18.792214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.792656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.793441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.793876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.850902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:18.851623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:18.858615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.859330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.860258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:18.860995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:18.936353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.943969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38b57af1-87a7-43bb-90be-4fdf082e2d17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.162880 Aug 03 09:31:18.944832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 71/127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:18 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:18.989972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:18.997292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7843d41c-b4d6-4e62-84af-0ba46c3b74c5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.150796 Aug 03 09:31:18.997852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 57/128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:18 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:19.150852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:19.151476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:19.157465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.157903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.158645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.159070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.296316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:19.304266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:19.305796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:19.306944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e19cdc60-2aab-4327-96e9-ce0ad150e39f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.159902 Aug 03 09:31:19.307445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 72/129] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:31:19.553072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:19.553816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:19.560400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.560780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.561591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.562025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.572166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:19.572903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:19.578778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.579222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.579965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.580391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.711573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:19.716732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:19.719120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96fd57fe-02c5-422b-b646-12ac5fc20657 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.170700 Aug 03 09:31:19.719693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 58/130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:19 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:19.724967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3c220691-dda7-411e-8c16-d0527c0f7847 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.157904 Aug 03 09:31:19.725772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 73/131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:19.964608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:19.965244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:19.971254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.971704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:19.972465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:19.972928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.018259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:20.018903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:20.024936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.025385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.026149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.026581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.137342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.146167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5148ab4e-8ab9-4842-9175-1e8aede302ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.185302 Aug 03 09:31:20.147072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 59/132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:19 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:20.178648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.186398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c6c6f0d3-ba54-40c3-8e43-09c4328648e2 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1315 microversion: 2.1 time: 0.171819 Aug 03 09:31:20.187136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 74/133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:20 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:20.329683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:20.330284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:20.336444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.336917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.337675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.338127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.486739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.496611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.498182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.499365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d6b0e591-b5bc-4670-8e42-1ee6ccaf6ad5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.173789 Aug 03 09:31:20.500135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 60/134] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:20.742439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:20.743048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:20.748867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:20.749782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.750849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.751542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:20.751722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.753042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.762968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.763635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.764962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:20.765668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:20.954337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.964397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-819a64d1-075d-4a59-8a9f-e3b06d6d5a1e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.227820 Aug 03 09:31:20.965611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 75/135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:20 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:20.971245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:20.981124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-956d6051-320e-4e80-8a6a-0c44f7017070 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1364 microversion: 2.1 time: 0.237879 Aug 03 09:31:20.982037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 61/136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:21.167889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:21.168532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:21.171564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:21.181543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.181997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.182776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.183207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.212129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:21.212653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:21.222270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.223217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.224991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.225744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.384855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:21.403813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae8255ad-070b-444c-93e9-41f427b57606 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.239590 Aug 03 09:31:21.404480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 76/137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:21 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:21.443649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:21.451819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-235a7d89-0664-4d92-8755-92a94f298a95 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1502 microversion: 2.1 time: 0.245276 Aug 03 09:31:21.452351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 62/138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:21 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:21.523427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:21.524365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:21.530667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.531225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.532283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.532833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.719428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:21.731456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:21.733261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:21.734646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c49c4f9-7982-4d7d-b925-41e5e667af6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.216443 Aug 03 09:31:21.735456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 77/139] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:21.990550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:21.991095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:21.997098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.997531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:21.998294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:21.998726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.008850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:22.009465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:22.015371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.015817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.016569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.017037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.135036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:22.151468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-20af1232-9362-4e88-a2e7-efbd03d280c5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.165406 Aug 03 09:31:22.152050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 63/140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:21 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:22.170313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:22.178763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e742c408-d126-46f3-85b1-2d2ac5ba7177 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1549 microversion: 2.1 time: 0.174914 Aug 03 09:31:22.179335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 78/141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:22.200927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:22.201421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:22.207532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.208017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.208890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.209328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.389848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0df8b56c-8cb4-4f25-b677-d583dc4704fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192780 Aug 03 09:31:22.390588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 64/142] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:31:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:22.425067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:22.425680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:22.433166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.433801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.435238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.436111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.641782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:22.652986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4fb2fbba-a851-4263-8da5-c0608821add2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.231103 Aug 03 09:31:22.670722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 79/143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:22 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:22.765521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:22.766527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:22.778800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.779425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.780893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.781588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.815612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:22.920869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3df9e783-f371-4d8d-bb89-521997e13fa6"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:22.924442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:22.930751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.931193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:22.932160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:22.932399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.196453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:23.206355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:23.209320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:23.210772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff434d1e-5541-430e-a10f-04b27bb9844d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.453620 Aug 03 09:31:23.222423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 65/144] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:23.236352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:23.237353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:23.250070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:23.250729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.252233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:23.253357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.342894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b79dd6a8-4577-46c4-bf3b-17df80f583f0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "POST /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426077 Aug 03 09:31:23.344780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 80/145] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:31:22 2022] POST /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:31:23.354137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-0c75a958-f9eb-4a06-8421-0375d2ed5057 req-557c02b9-a7be-49d2-aad6-c90992e1ff23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708ec0aa-3818-45fd-9be1-1832b91abdbc", "name": "network-vif-plugged", "status": "completed", "tag": "a6eb1086-96d4-48f1-ba49-b2cdf68828f9"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:23.367289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0c75a958-f9eb-4a06-8421-0375d2ed5057 req-557c02b9-a7be-49d2-aad6-c90992e1ff23 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:23.368061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0c75a958-f9eb-4a06-8421-0375d2ed5057 req-557c02b9-a7be-49d2-aad6-c90992e1ff23 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.385244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-0c75a958-f9eb-4a06-8421-0375d2ed5057 req-557c02b9-a7be-49d2-aad6-c90992e1ff23 service nova] Creating event network-vif-plugged:a6eb1086-96d4-48f1-ba49-b2cdf68828f9 for instance 708ec0aa-3818-45fd-9be1-1832b91abdbc on hv-cinder-84456 Aug 03 09:31:23.403392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-0c75a958-f9eb-4a06-8421-0375d2ed5057 req-557c02b9-a7be-49d2-aad6-c90992e1ff23 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054941 Aug 03 09:31:23.405037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 81/146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:23.684283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:23.686645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:23.709584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:23.710899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.712850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:23.713980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:23.715508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:23.736206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f814eb3b-70ed-479a-a77e-fea7113fc1db tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.512290 Aug 03 09:31:23.737803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 66/147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:23 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:24.025977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:24.035789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29e4f8ed-ad73-4211-9301-f065d5860de3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.358804 Aug 03 09:31:24.037625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 82/148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:23 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:24.250231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:24.250970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:24.257434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:24.258133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:24.259072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:24.259665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:24.698149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:24.707574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:24.710143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:24.711455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2a569d58-f9d6-4b63-9af7-f118c66221da tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.464930 Aug 03 09:31:24.712084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 67/149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:24.759374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:24.760784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:24.768063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:24.768766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:24.769642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:24.770199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:24.921756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:24.932658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f6b5d0e-77c2-44a9-919b-e2940b56c609 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.177286 Aug 03 09:31:24.933752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 83/150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:24 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:25.006925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-65cdd764-6339-4a75-b51a-deb17285a6f5 req-e3505b14-4559-4dba-afe5-7c5c223ffff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a1a022-8f7e-4e28-9a07-49184dfcfcfd", "tag": "11fbb955-cb55-401d-b52c-df2706864e50"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:25.024570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65cdd764-6339-4a75-b51a-deb17285a6f5 req-e3505b14-4559-4dba-afe5-7c5c223ffff1 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.025159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65cdd764-6339-4a75-b51a-deb17285a6f5 req-e3505b14-4559-4dba-afe5-7c5c223ffff1 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.052886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-65cdd764-6339-4a75-b51a-deb17285a6f5 req-e3505b14-4559-4dba-afe5-7c5c223ffff1 service nova] Creating event network-changed:11fbb955-cb55-401d-b52c-df2706864e50 for instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd on hv-cinder-84456 Aug 03 09:31:25.060346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-65cdd764-6339-4a75-b51a-deb17285a6f5 req-e3505b14-4559-4dba-afe5-7c5c223ffff1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057666 Aug 03 09:31:25.065001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 68/151] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:25.065962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:25.068906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:25.076040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.077491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.078588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.079303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.234900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:25.245727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-58b0c6cd-e732-46e7-866d-aabd98796d43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.185121 Aug 03 09:31:25.247935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 84/152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:25 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:25.438477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dcc900-18b4-4f36-911d-e61fc4a9cc58", "name": "network-vif-plugged", "status": "completed", "tag": "a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f"}, {"server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "name": "network-vif-plugged", "status": "completed", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}, {"server_uuid": "b3166329-2bc2-4aea-983b-a8e05ff43d38", "name": "network-vif-plugged", "status": "completed", "tag": "779880c1-0e74-44a1-b797-d284789bbdc6"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:25.460237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.461161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.518866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Creating event network-vif-plugged:a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f for instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 on hv-cinder-84456 Aug 03 09:31:25.520215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Creating event network-vif-plugged:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:31:25.525215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] Creating event network-vif-plugged:779880c1-0e74-44a1-b797-d284789bbdc6 for instance b3166329-2bc2-4aea-983b-a8e05ff43d38 on hv-cinder-84456 Aug 03 09:31:25.583279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-307f15a3-8066-4edf-8630-99de81095674 req-6d62b501-74f0-4349-b99a-c12c6fdfbfff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.148652 Aug 03 09:31:25.586604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 69/153] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:25.739810 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:25.740693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:25.749352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.749803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.750579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.751013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.915410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:25.919977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:25.926963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:25.928659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:25.930061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66b07674-d541-4ad6-9fb1-cafc781f7aea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.194297 Aug 03 09:31:25.930824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 85/154] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:25.971136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:25.972588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:25.981021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.981766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:25.982779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:25.983209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:26.271065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:26.271877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:26.292127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:26.293175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:26.294332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:26.298326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:26.300127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:26.302031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8055e772-fa1f-4624-a4f6-98c7b84193ee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.336971 Aug 03 09:31:26.305522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 70/155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:25 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:26.506060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:26.525892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1335aa1a-540f-4c52-bd36-c567fe58c65c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.261621 Aug 03 09:31:26.528130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 86/156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:26 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:26.974682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:26.975818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:26.993081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:26.993693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:26.995019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:26.995855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:27.214397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:27.225677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:27.227264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:27.229268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b4b8b91-acdd-455d-b31b-57ca2432b5ac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.264478 Aug 03 09:31:27.230012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 71/157] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:27.326847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:27.328035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:27.334638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:27.335203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:27.335975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:27.336542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:27.498686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:27.508527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a5fb148-1bbe-42ea-8586-da58761d81aa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.185677 Aug 03 09:31:27.509138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 87/158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:27 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:27.552950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:27.553621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:27.555576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:27.560740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:27.561400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:27.562162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:27.562591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:27.708698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:27.717290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c5498a46-9f88-448e-b6f7-cc5071a121bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.169037 Aug 03 09:31:27.717858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 72/159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:27 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:28.257356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:28.257984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:28.265302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.265988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.266943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.267377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.431391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:28.440404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:28.442090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:28.449515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-80d71f48-f62d-4ae6-8f69-db07b64a357b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1407 microversion: 2.20 time: 0.197648 Aug 03 09:31:28.465249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 88/160] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:28.529803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:28.534882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:28.541091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.541713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.542944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.543569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.711576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:28.721824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f01836a5-ad37-4f58-8871-be2563a4c127 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.195925 Aug 03 09:31:28.724892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 73/161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:28 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:28.737353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:28.738584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:28.746309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.746756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.747527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:28.747990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:28.918900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:28.927785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6583ff1b-04fb-41f0-b5a5-2f2dbfdbdece tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1322 microversion: 2.1 time: 0.193614 Aug 03 09:31:28.928463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 89/162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:28 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:29.478346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:29.478946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:29.485103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.485629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.486419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.486841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.652221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:29.660547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:29.662339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:29.663617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ed90971-d521-451a-abba-87cd0f951b1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1599 microversion: 2.20 time: 0.194072 Aug 03 09:31:29.664189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 74/163] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:31:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:31:29.687830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:29.688388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:29.695831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.696284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.697099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.697538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.746240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:29.747282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:29.754420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.755670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.756491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.757076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.786432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9909a682-2e08-41a4-b986-e6695b9641a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102203 Aug 03 09:31:29.787278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 90/164] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 3 09:31:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:31:29.949358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:29.950747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:29.957822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.959244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:29.960386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:29.961170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:30.087109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:30.098971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d6833a0-0fec-416d-8e7a-dc8e5363b3c0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1368 microversion: 2.1 time: 0.355523 Aug 03 09:31:30.113028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 75/165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:29 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:30.143875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:30.152420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-858c88f7-2bfa-4b05-bfad-d0c7fe322421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1516 microversion: 2.1 time: 0.207707 Aug 03 09:31:30.153301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 91/166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:29 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:30.175538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:30.178068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:30.186364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:30.186815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:30.187786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:30.188550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:30.215501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'flavor' on Instance uuid b3166329-2bc2-4aea-983b-a8e05ff43d38 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:31:30.362479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce402ff7-f1f4-4e19-b20d-ac47037646f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38/action" status: 200 len: 32 microversion: 2.1 time: 0.191378 Aug 03 09:31:30.363108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 76/167] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:31:30 2022] POST /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 09:31:30.373947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:30.374757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:30.382186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:30.382871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:30.383656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:30.384401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:30.683372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:30.693306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-beb444c6-61e9-420b-b0e2-1d339034aae1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.323464 Aug 03 09:31:30.695562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 92/168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:30 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:31.127942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:31.129648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:31.138013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.138798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.139821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.140463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.546747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:31.554996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-da1db5bc-47d3-4515-8478-ea91672f5c8c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1558 microversion: 2.1 time: 0.432109 Aug 03 09:31:31.555643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 77/169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:31 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1558 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:31.578401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:31.578890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:31.586369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.586792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.587548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.587979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.696977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ccd44505-2892-407e-9f5a-356c1dcb01a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122284 Aug 03 09:31:31.704683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 93/170] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:31:31 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:31.722285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:31.723113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:31.731055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.731627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.732559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.733098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:31.945001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-af29063f-8b4a-48ee-a328-282bbd841cd0 req-7ed82945-38fc-4bdb-84d1-dea75203e760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:31.997172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-af29063f-8b4a-48ee-a328-282bbd841cd0 req-7ed82945-38fc-4bdb-84d1-dea75203e760 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:31.997915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-af29063f-8b4a-48ee-a328-282bbd841cd0 req-7ed82945-38fc-4bdb-84d1-dea75203e760 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:32.030328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-af29063f-8b4a-48ee-a328-282bbd841cd0 req-7ed82945-38fc-4bdb-84d1-dea75203e760 service nova] Creating event network-changed:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:31:32.050321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-af29063f-8b4a-48ee-a328-282bbd841cd0 req-7ed82945-38fc-4bdb-84d1-dea75203e760 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103874 Aug 03 09:31:32.051627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 94/171] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:31:32.061707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:32.074494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fd729b0-f32c-4021-82a8-9bea08fb86ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.362724 Aug 03 09:31:32.081902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 78/172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:31 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:33.098925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:33.100709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:33.131617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:33.135929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:33.137441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:33.144689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:33.494953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:33.502714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5db059c-f357-4696-bb56-9238d50e7684 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.409653 Aug 03 09:31:33.503498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 95/173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:33 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:33.838083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-84911c88-6d41-4f91-a2e4-f9fc7e478ada req-ed54d06f-4ed8-4b98-85d4-80c0c1920754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dcc900-18b4-4f36-911d-e61fc4a9cc58", "tag": "a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:33.871274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-84911c88-6d41-4f91-a2e4-f9fc7e478ada req-ed54d06f-4ed8-4b98-85d4-80c0c1920754 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:33.871274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-84911c88-6d41-4f91-a2e4-f9fc7e478ada req-ed54d06f-4ed8-4b98-85d4-80c0c1920754 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:33.894195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-84911c88-6d41-4f91-a2e4-f9fc7e478ada req-ed54d06f-4ed8-4b98-85d4-80c0c1920754 service nova] Creating event network-changed:a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f for instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 on hv-cinder-84456 Aug 03 09:31:33.900842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-84911c88-6d41-4f91-a2e4-f9fc7e478ada req-ed54d06f-4ed8-4b98-85d4-80c0c1920754 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066664 Aug 03 09:31:33.901888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 79/174] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:34.428524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:34.430024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:34.445552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.446352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.447551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.448428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.490109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:31:34.524839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:34.526304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:34.541226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.543611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.544691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.549212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.713203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5ea04ff1-42cf-427a-b266-10e1e2539213 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 204 len: 0 microversion: 2.1 time: 0.287127 Aug 03 09:31:34.714230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 96/175] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:31:34 2022] DELETE /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:31:34.725319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:34.726536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:34.734377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.735790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.737843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:34.738457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:34.869237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:34.878892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b7f6d926-152d-43ae-8645-cb90c630fb0c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.359006 Aug 03 09:31:34.897068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 80/176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:34 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:34.954484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:34.964406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e80c9da1-8e3e-4c8e-81bc-526f37edcf11 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1554 microversion: 2.1 time: 0.245690 Aug 03 09:31:34.968578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 97/177] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:34 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:35.901819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:35.902503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:35.908648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:35.909203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:35.910023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:35.910540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:35.987882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:35.989576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:35.998312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:35.998997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:36.000145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:36.001120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:36.055263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:36.069337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1cf558cf-c666-457b-af43-76f711c49df1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.171128 Aug 03 09:31:36.087568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 81/178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:35 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:36.180417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:36.188876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e53c7923-5fd5-4411-be58-698c2f7fcd49 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1554 microversion: 2.1 time: 0.206902 Aug 03 09:31:36.189455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 98/179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:35 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:37.094446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:37.096217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:37.110578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:37.111039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:37.111844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:37.112261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:37.141886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:37.210912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:37.212249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:37.218933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:37.219463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:37.220300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:37.220896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:37.388145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:37.397286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e865b812-959c-4c81-bf39-9d7db3b472f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.309039 Aug 03 09:31:37.409091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 82/180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:37 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:37.434682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:37.443919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3f6ad0f-8a05-4e54-b9a1-add285304120 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1554 microversion: 2.1 time: 0.236805 Aug 03 09:31:37.445020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 99/181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:37 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:37.705396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f230b3df-1df8-4b67-9d64-f2987aff1d92 req-38e7a9e9-377e-4ed8-93b1-88b774ba06fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc1c84c-9403-45ab-987b-c0e33d70b89c", "name": "network-vif-deleted", "tag": "5bef86f0-0366-4357-ae69-095f33a29c62"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:31:37.721074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f230b3df-1df8-4b67-9d64-f2987aff1d92 req-38e7a9e9-377e-4ed8-93b1-88b774ba06fb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:37.721788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f230b3df-1df8-4b67-9d64-f2987aff1d92 req-38e7a9e9-377e-4ed8-93b1-88b774ba06fb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:37.747125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f230b3df-1df8-4b67-9d64-f2987aff1d92 req-38e7a9e9-377e-4ed8-93b1-88b774ba06fb service nova] Creating event network-vif-deleted:5bef86f0-0366-4357-ae69-095f33a29c62 for instance fbc1c84c-9403-45ab-987b-c0e33d70b89c on hv-cinder-84456 Aug 03 09:31:37.762998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f230b3df-1df8-4b67-9d64-f2987aff1d92 req-38e7a9e9-377e-4ed8-93b1-88b774ba06fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069972 Aug 03 09:31:37.762998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 83/182] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:31:38.419209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:38.419817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:38.426222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:38.427901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:38.428663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:38.429147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:38.466502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:38.467213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:38.474162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:38.474852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:38.475819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:38.476315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:38.547321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:38.571324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:38.571578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ba788ac1-2f28-42f1-902c-a7275ad37397 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1512 microversion: 2.1 time: 0.109428 Aug 03 09:31:38.572072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 84/183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:38 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1512 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:38.585033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25eb641a-051e-4814-bf29-8510b62f4afa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.165001 Aug 03 09:31:38.585033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 100/184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:38 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:39.595322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:39.595972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:39.603054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:39.603502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:39.604262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:39.604536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:39.605021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:39.605201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:39.611204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:39.611648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:39.612408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:39.612860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:39.671178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:39.680033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-edfae520-d1a7-4831-8275-1c0ee6b549bf tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1512 microversion: 2.1 time: 0.088582 Aug 03 09:31:39.680606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 101/185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:39 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1512 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:39.746719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:39.754200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-28c74372-ef4e-4d97-bedc-f10a4332faa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.153906 Aug 03 09:31:39.754876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 85/186] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:39 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:40.701642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:40.702238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:40.710096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:40.710543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:40.711372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:40.711808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:40.716009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:40.745208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:40.745654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:40.746121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lazy-loading 'fault' on Instance uuid fbc1c84c-9403-45ab-987b-c0e33d70b89c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:31:40.775942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:40.776648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:40.783356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:40.784465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:40.785407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:40.786924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:40.796088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca0fa48bca5d4ee4a8e5a5ad4253e570', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad698ec9040442478293005d3e8e1cb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:40.804333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f8a3fba4-eb55-493e-b733-6f58f6cec865 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 200 len: 1351 microversion: 2.1 time: 0.106447 Aug 03 09:31:40.804923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 102/187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:40 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 1351 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:40.953160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:40.961952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-640ca203-0ea8-4761-8b18-2ce9504cb9df tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.190007 Aug 03 09:31:40.962526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 86/188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:40 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:41.826688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:41.827295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:41.834005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.834468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.835224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.835655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.849566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] HTTP exception thrown: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Request method failure captured: Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c HTTP/1.1 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA-UjNzxkMA9vW9mPhXiBZugYhlryizPiS76pNjyuqKuyfkGdgw3-GP2CRAKzBlv17Q8e-eKI7JKK6UXgNapOq7jvdGYKzBDTd66bgA7HXqySOgPykdidUdO-_XOWPpOBTBVoR7TaW1sn3gxxhD8vWFMcxcg89gsClkgHwPAaxebEg Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:31:41.854089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}] Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: ca0fa48bca5d4ee4a8e5a5ad4253e570 Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.855561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'fbc1c84c-9403-45ab-987b-c0e33d70b89c'} Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:31:41.856412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.857835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.859227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Returning 404 to user: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:31:41.859227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a46e9a5c-959f-4f6f-a012-536040944bf0 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 404 len: 111 microversion: 2.1 time: 0.032822 Aug 03 09:31:41.859227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 103/189] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:41 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:31:41.963953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:41.966207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:41.972104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.972546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.973910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.974387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.984370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:41.985011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:41.987440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] HTTP exception thrown: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.991576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.992025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.992774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:41.993226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Request method failure captured: Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c/os-volume_attachments HTTP/1.1 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA-UjNzxkMA9vW9mPhXiBZugYhlryizPiS76pNjyuqKuyfkGdgw3-GP2CRAKzBlv17Q8e-eKI7JKK6UXgNapOq7jvdGYKzBDTd66bgA7HXqySOgPykdidUdO-_XOWPpOBTBVoR7TaW1sn3gxxhD8vWFMcxcg89gsClkgHwPAaxebEg Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:31:41.994462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}] Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: ca0fa48bca5d4ee4a8e5a5ad4253e570 Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.995592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': 'fbc1c84c-9403-45ab-987b-c0e33d70b89c'} Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:31:41.996227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:41.997725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:41.998970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Returning 404 to user: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:31:41.998970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d41e3986-8314-4412-a33d-60f259690f10 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035969 Aug 03 09:31:41.998970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 87/190] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:31:41 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:31:42.126701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:42.135425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ccf41f47-d9a2-4857-9230-17e0cca95b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.154875 Aug 03 09:31:42.136003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 104/191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:41 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:43.156338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:43.156978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:43.163623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:43.164063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:43.164802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:43.165246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:43.297503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:43.304983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a1c84f11-6081-448d-a893-3dc729221b32 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.152490 Aug 03 09:31:43.305544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 88/192] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:43 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:44.325988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:44.326597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:44.334080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:44.334531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:44.335290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:44.335725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:44.469140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:44.477692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3e7c296-47ac-4841-bba9-c56a277a8bb5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.155295 Aug 03 09:31:44.478063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 105/193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:44 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:45.318469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:45.321012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:45.328911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.329517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.330528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.331168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.345548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] HTTP exception thrown: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Request method failure captured: Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c HTTP/1.1 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA-UjNzxkMA9vW9mPhXiBZugYhlryizPiS76pNjyuqKuyfkGdgw3-GP2CRAKzBlv17Q8e-eKI7JKK6UXgNapOq7jvdGYKzBDTd66bgA7HXqySOgPykdidUdO-_XOWPpOBTBVoR7TaW1sn3gxxhD8vWFMcxcg89gsClkgHwPAaxebEg Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:31:45.347647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}] Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: ca0fa48bca5d4ee4a8e5a5ad4253e570 Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.349216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'fbc1c84c-9403-45ab-987b-c0e33d70b89c'} Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:31:45.349865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.351046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.352109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Returning 404 to user: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:31:45.352109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e096e70c-d65d-441b-93dc-41378fb793f5 tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 404 len: 111 microversion: 2.1 time: 0.035457 Aug 03 09:31:45.352109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 89/194] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:31:45 2022] DELETE /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:31:45.357651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:45.358260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] [instance: fbc1c84c-9403-45ab-987b-c0e33d70b89c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:45.365645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.366184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.367115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.367551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.381797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] HTTP exception thrown: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Request method failure captured: Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c HTTP/1.1 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA-UjNzxkMA9vW9mPhXiBZugYhlryizPiS76pNjyuqKuyfkGdgw3-GP2CRAKzBlv17Q8e-eKI7JKK6UXgNapOq7jvdGYKzBDTd66bgA7HXqySOgPykdidUdO-_XOWPpOBTBVoR7TaW1sn3gxxhD8vWFMcxcg89gsClkgHwPAaxebEg Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:31:45.383349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ad698ec9040442478293005d3e8e1cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ad698ec9040442478293005d3e8e1cb3"}]}] Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: ad698ec9040442478293005d3e8e1cb3 Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-DeleteServersTestJSON-1465813669 Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: ca0fa48bca5d4ee4a8e5a5ad4253e570 Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-DeleteServersTestJSON-1465813669-project Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.384761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'fbc1c84c-9403-45ab-987b-c0e33d70b89c'} Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:31:45.385616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. Aug 03 09:31:45.386642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:31:45.387575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] Returning 404 to user: Instance fbc1c84c-9403-45ab-987b-c0e33d70b89c could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:31:45.387575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f85f5cb2-ee1c-4d42-bebc-6e2e8f90179e tempest-DeleteServersTestJSON-1465813669 tempest-DeleteServersTestJSON-1465813669-project] 10.222.0.20 "GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c" status: 404 len: 111 microversion: 2.1 time: 0.030867 Aug 03 09:31:45.387575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 106/195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:45 2022] GET /compute/v2.1/servers/fbc1c84c-9403-45ab-987b-c0e33d70b89c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:31:45.499669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:45.500609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:45.508218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.509031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.510025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:45.510456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:45.652648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:45.660595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8682116c-3b55-432b-98e3-8d2165d0cf00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.164961 Aug 03 09:31:45.661259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 90/196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:45 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:46.682338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:46.683574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:46.690477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:46.690931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:46.691709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:46.692181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:46.914490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:46.922089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08803935-0cde-40fb-b94f-4cb456b29d53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.243600 Aug 03 09:31:46.922852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 107/197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:46 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:47.946571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:47.947163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:47.957629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:47.958238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:47.959159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:47.959599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:48.118681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:48.126491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-338364ed-7770-4585-99cd-f6e66b3e0927 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.186631 Aug 03 09:31:48.126987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 91/198] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:47 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:49.149333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:49.150324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:49.157244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:49.157928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:49.158704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:49.159141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:49.523935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:49.531882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-037fbb9a-b918-40bf-8125-79fe79c5e676 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.386949 Aug 03 09:31:49.532631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 108/199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:49 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:50.554351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:50.554983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:50.571328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:50.571802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:50.572588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:50.573062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:50.707398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:50.718541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ae5e601-57a3-4ce1-9d6c-76d7c4c9216c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.169322 Aug 03 09:31:50.719118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 92/200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:50 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:51.739664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:51.740271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:51.742693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:51.747955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:51.748398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:51.749193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:51.749809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:51.884033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:51.893065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-918f1dbc-7317-4f96-bea1-21ca8f3192e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.157257 Aug 03 09:31:51.893687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 109/201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:51 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:31:52.918453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:52.919073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:52.925389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:52.925835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:52.927264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:52.927705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:53.062997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:53.071581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04659fa9-41a8-4ec2-a574-6e5eed5a4c55 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.157735 Aug 03 09:31:53.072137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 93/202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:52 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:54.092359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:54.092999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:54.099548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:54.099997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:54.100790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:54.101245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:54.229173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:54.236842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a06dfb26-a347-461d-85ff-03b002f64ba4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.148432 Aug 03 09:31:54.237440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 110/203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:54 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:55.259058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:55.259565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:55.265460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:55.265897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:55.266638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:55.267059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:55.401199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:55.408704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62480d89-b71d-4ece-a2ed-8cbdc703731d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.153596 Aug 03 09:31:55.409302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 94/204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:55 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:56.429807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:56.430416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:56.436915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:56.437359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:56.438123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:56.438557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:56.571323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:56.579732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db90feba-5e12-41fd-8a36-00742281c423 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.154973 Aug 03 09:31:56.580946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 111/205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:56 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:57.602758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:57.603358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:57.605318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=46 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:31:57.610540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:57.610974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:57.611719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:57.612146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:57.747216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:57.756105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5dc514d-00ae-44f7-8e7e-2384c13a2345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.157670 Aug 03 09:31:57.756696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 95/206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:57 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:58.777411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:58.778016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:58.784994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:58.785483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:58.786882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:58.787353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:58.921171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:31:58.929923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f4539af-ab9b-46fe-81ad-56ec81f852c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.156361 Aug 03 09:31:58.930484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 112/207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:58 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:31:59.949897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:31:59.950494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:31:59.956530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:59.957025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:31:59.958144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:31:59.958588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:00.092092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:00.100492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d06924c-052b-4a06-a654-f94c0c195703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.154493 Aug 03 09:32:00.101227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 96/208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:31:59 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:01.121474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:01.122088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:01.128584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:01.129071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:01.129830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:01.130268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:01.258918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:01.267034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-106a8e77-e486-4d41-b8b7-9f3f91897be2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.149413 Aug 03 09:32:01.267601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 113/209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:01 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:02.287673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:02.288266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:02.294280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:02.294725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:02.295486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:02.295923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:02.423422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:02.431918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb25169c-d7df-453d-9e06-885e19730217 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.148278 Aug 03 09:32:02.432493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 97/210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:02 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:03.453654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:03.454255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:03.462069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:03.462908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:03.463828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:03.464541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:03.666754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:03.675721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c86daaf-d8ab-45ff-b777-043a5042dcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.225727 Aug 03 09:32:03.676948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 114/211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:03 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:04.701691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:04.702309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:04.709172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:04.709672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:04.710474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:04.710906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:04.903746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:04.911569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd2536bf-a27b-446e-9939-77e252e0d4d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.213748 Aug 03 09:32:04.912334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 98/212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:04 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:05.934023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:05.934630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:05.941631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:05.942077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:05.943073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:05.943514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:06.117448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:06.125369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-403482ff-e245-4903-bd69-cc46944b6f6a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.195121 Aug 03 09:32:06.125945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 115/213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:05 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:07.151730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:07.152431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:07.165506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:07.166208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:07.167091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:07.167535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:07.170413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=89 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:07.437812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:07.446221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bf8df659-6da0-4744-b00d-b0565b884b9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.302603 Aug 03 09:32:07.460151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 99/214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:07 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:08.473076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:08.474917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:08.485189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:08.485745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:08.488363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:08.488920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:08.676169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:08.686717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8f6dc3f2-e66c-4997-badf-e93aac1803a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.221916 Aug 03 09:32:08.688084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 116/215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:08 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:09.711626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:09.712246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:09.718701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:09.719148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:09.720633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:09.721244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:09.932859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:09.942976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-29d34b57-f30d-462a-845d-31148acc1ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.236368 Aug 03 09:32:09.956458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 100/216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:09 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:10.967739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:10.968345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:10.981056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:10.981821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:10.982772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:10.984215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:10.989799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=83 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:11.295026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:11.306336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9018eb6f-da0f-4770-ac49-84c2d6213f10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.342675 Aug 03 09:32:11.308347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 117/217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:10 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:12.328400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:12.329407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:12.336089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:12.336536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:12.337359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:12.337793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:12.537971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:12.546509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-066ad962-33aa-47fe-b51c-f5e0efd06d45 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.221887 Aug 03 09:32:12.548039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 101/218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:12 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:13.572469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:13.573203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:13.584635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:13.585139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:13.585919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:13.586354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:13.812411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:13.822792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b60dc3b-6cad-4ffe-80f4-be1349ef50b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.256481 Aug 03 09:32:13.823802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 118/219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:13 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:14.843450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:14.844208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:14.850977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:14.851495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:14.852351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:14.852999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:14.972734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-809eeeb5-c4b8-45f3-a4b0-81e5af64a4ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Action: 'create', calling method: .version_select at 0x7fb9995ea040>, body: {"keypair": {"name": "tempest-TestShelveInstance-586809750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWNLfaI4iRrYjvoSAPIYmpbToGKwyq3OYbAHFxKgTLlxmO/XIcvUAL12uVdDWlSo5mca9D8ndNs64v5lWCiA9vmTlTxg0PdJNr/0gZGgJQecp2ptWDiBp4lP27sXuum4Q=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:14.997590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-809eeeb5-c4b8-45f3-a4b0-81e5af64a4ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Getting quotas for project c0f1be2882b542668029c26092bd87b7. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:32:15.001798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-809eeeb5-c4b8-45f3-a4b0-81e5af64a4ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Getting quotas for user bb2ba828da0f4ea583a7c6e5471bf2df and project c0f1be2882b542668029c26092bd87b7. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:32:15.005487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:15.013897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-de222bad-b2b3-4341-84d4-cbaadeeebcef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.174161 Aug 03 09:32:15.014700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 119/220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:14 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:15.054434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-809eeeb5-c4b8-45f3-a4b0-81e5af64a4ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.308605 Aug 03 09:32:15.055265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 102/221] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:32:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:32:16.043084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:16.043694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:16.068250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:16.076797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:16.077814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:16.078289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:16.319724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:16.328379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a2466f16-c14c-4301-aae5-910bf1b5f2a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.291597 Aug 03 09:32:16.329209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 120/222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:16 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:17.350936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:17.351472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:17.357677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:17.358127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:17.358928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:17.359648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:17.499831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:17.508090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6632ca3-2bc6-489d-bda9-a88f02275efd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.161682 Aug 03 09:32:17.508678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 103/223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:17 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:18.529442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:18.529994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:18.536687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:18.537194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:18.538483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:18.539009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:18.699660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:18.707511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3dec3574-ba0e-44d1-b275-426a7021d918 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.182513 Aug 03 09:32:18.708102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 121/224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:18 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:19.731883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:19.732609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:19.738697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:19.739140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:19.739902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:19.740332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:19.884645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:19.893917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5a60995-d01a-4483-97d4-aaa697990943 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.165803 Aug 03 09:32:19.894489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 104/225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:19 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:20.917268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:20.917879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:20.925807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:20.926348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:20.927147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:20.931288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:21.075060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:21.085697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7e48bf41-44b5-46b4-abcf-e24fa0325f0f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.173542 Aug 03 09:32:21.086283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 122/226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:20 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:22.113291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:22.113892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:22.121807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:22.122253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:22.123130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:22.123631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:22.266696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:22.274278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08d8d4d6-3d51-4062-9ab7-d361c414e8f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.164881 Aug 03 09:32:22.274837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 105/227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:22 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:23.295083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:23.295787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:23.297729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=28 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:23.303676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:23.304353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:23.305419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:23.305845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:23.584046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:23.592988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29f2ddf2-7d16-4957-a366-d3a65d86e7e6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.301903 Aug 03 09:32:23.593555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 123/228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:23 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:24.614275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:24.614882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:24.621734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:24.622177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:24.622926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:24.623360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:24.822675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:24.847062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb549621-9edf-4cc8-a037-43318743baab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.236517 Aug 03 09:32:24.848287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 106/229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:24 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:25.870887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:25.871584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:25.890800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:25.891253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:25.892222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:25.892664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:26.067830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:26.077077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-10be37a1-e740-4aad-b27b-56abffabd138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.210844 Aug 03 09:32:26.078048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 124/230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:25 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:27.099631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:27.101410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:27.106671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:27.108687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:27.109155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:27.109921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:27.110351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:27.264177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:27.272720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ac01f921-1489-48d8-85ac-17e5ddebd3bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.176273 Aug 03 09:32:27.273562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 107/231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:27 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:28.295294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:28.296477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:28.311786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:28.312765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:28.313789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:28.314331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:28.465907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:28.475869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-37b42bae-2e25-407b-b4ee-fc1ae04f8fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.183877 Aug 03 09:32:28.477125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 125/232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:28 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:29.499026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:29.499696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:29.501743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:29.507660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:29.508106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:29.508916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:29.509380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:29.659794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:29.668981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6462fcf1-c966-4a0b-800f-a6332e3f4718 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.173425 Aug 03 09:32:29.683194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 108/233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:29 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:30.691049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:30.692459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:30.700511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:30.701014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:30.701900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:30.702282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:30.855705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:30.864648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dddedd20-8360-45e6-ac1e-2e23e5985ff7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.177800 Aug 03 09:32:30.865469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 126/234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:30 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:31.890519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:31.891150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:31.898579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:31.898984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:31.899870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:31.900440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:32.108412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:32.120121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e37d5640-684c-4e8d-9b3a-5c732a9cc7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1522 microversion: 2.1 time: 0.233299 Aug 03 09:32:32.120738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 109/235] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:31 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:33.141764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:33.143040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:33.153375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:33.153821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:33.154591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:33.155016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:33.331908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:33.351505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-32961b95-aecc-4896-a86e-219daa71d381 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1502 microversion: 2.1 time: 0.203924 Aug 03 09:32:33.351505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 127/236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:33 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:33.363671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:33.364314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:33.379190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:33.379639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:33.380486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:33.380953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:33.547059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:33.556365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-251f4e37-f1a4-408e-bc80-7a4299009f5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1514 microversion: 2.1 time: 0.197188 Aug 03 09:32:33.570322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 110/237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:33 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:34.961468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:34.963709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:34.970220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:34.970668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:34.971435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:34.971866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:34.994911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'flavor' on Instance uuid 708ec0aa-3818-45fd-9be1-1832b91abdbc {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:32:35.112968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b00a247-5c5b-4ae5-ad5c-a37e25ed0e3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/action" status: 200 len: 32 microversion: 2.1 time: 0.156445 Aug 03 09:32:35.113606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 128/238] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:32:34 2022] POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 09:32:35.124712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:35.125466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:35.133207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:35.134156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:35.134938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:35.135365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:35.373527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:35.381880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e68700ae-ea6b-44e5-a383-d6b32587a4f0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.261747 Aug 03 09:32:35.382867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 111/239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:35 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:36.406834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:36.407527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:36.416928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:36.417841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:36.419152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:36.419692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:36.569947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:36.577978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a72a519f-f675-48ee-818f-15e0b02ef6cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.177599 Aug 03 09:32:36.578717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 129/240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:36 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:37.599404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:37.600101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:37.607169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:37.607617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:37.608379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:37.608898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:37.624667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=72 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:37.747775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:37.755448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90818e40-6fc8-4c1c-a5e8-8311488b10b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.159935 Aug 03 09:32:37.756007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 112/241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:37 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:38.776229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:38.776844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:38.783326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:38.783761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:38.784507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:38.784964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:38.916216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:38.923698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a1bc197-0cf5-4959-9a16-c61fc934b287 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.152055 Aug 03 09:32:38.924257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 130/242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:38 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:39.943590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:39.944323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:39.953557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:39.954008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:39.954799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:39.955223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:40.093787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:40.102110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-88cead0a-28d0-43aa-9ec4-9d0ac5fd0f87 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.161861 Aug 03 09:32:40.114021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 113/243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:39 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:41.117882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:41.118415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:41.123145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:41.123742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:41.125239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:41.125688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:41.126453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:41.126887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:41.129681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:41.130118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:41.130866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:41.131289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:41.141083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:41.151611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-562593d8-b695-4b73-9483-37d0ed3058ba tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/ips" status: 200 len: 152 microversion: 2.20 time: 0.038075 Aug 03 09:32:41.152193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 131/244] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 3 09:32:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:32:41.289764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:41.298802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4353cc61-2f92-4871-b146-affbcfae00cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.179404 Aug 03 09:32:41.299570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 114/245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:41 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:42.183237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:42.184338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:42.191828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:42.192235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:42.193229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:42.193650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:42.218006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ed62d872-a74a-44ab-b24a-7237556fec3a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/ips" status: 200 len: 150 microversion: 2.1 time: 0.039376 Aug 03 09:32:42.227968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 132/246] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:32:42 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:32:42.325343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:42.326784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:42.337382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:42.338067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:42.339053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:42.339840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:42.628381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:42.641684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1577676-6210-4caf-926f-e4e6b730bf54 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.321854 Aug 03 09:32:42.642256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 115/247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:42 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:43.685107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:43.685107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:43.685107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:43.685686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:43.686284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:43.686883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:43.860539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:43.870169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0425d3f7-d27a-4e2e-bb2c-aa3771759d1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.198152 Aug 03 09:32:43.878226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 133/248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:43 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:43.902646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60828bc0-ab0a-464a-9867-49f7fc877608"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:43.905696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:43.912176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:43.912625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:43.913415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:43.913863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.010894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:44.011456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:44.020212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.020889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.021766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.022274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.062225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lazy-loading 'flavor' on Instance uuid c30c986d-ad83-45a8-b4e6-96d056aaa6d5 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:32:44.323674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7c1b1a6-9b05-4b8e-9f8c-0f6c4234947a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426861 Aug 03 09:32:44.324364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 116/249] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:32:43 2022] POST /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:32:44.382096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5d63dc8-227f-40c4-9c9b-15b395ed5ad6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action" status: 202 len: 0 microversion: 2.20 time: 0.376079 Aug 03 09:32:44.383654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 134/250] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 3 09:32:44 2022] POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:32:44.404211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:44.404926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:44.423304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.426666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.427619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.428146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.812264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:44.823664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:44.825253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:44.827051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-46a6e16e-cd82-41bb-8879-56a7e8a585ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.438403 Aug 03 09:32:44.827890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 117/251] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:44.898565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:44.899544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:44.910800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.911323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:44.912079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:44.912514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:45.104879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:45.112677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ffe35504-5183-43cd-9f78-7aba00d3a477 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.223644 Aug 03 09:32:45.125943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 135/252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:44 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:45.854202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:45.854967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:45.863012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:45.863542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:45.864425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:45.864949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.005118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:46.015016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:46.017089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:46.018263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-179f8112-f5ec-4d6e-8c8d-56c671941511 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.169583 Aug 03 09:32:46.018828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 118/253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:46.069620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:46.070190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:46.080769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.081248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.082019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.082448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.108175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6cb1961e-54f0-4d8b-bc74-8260228b91bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/ips" status: 200 len: 145 microversion: 2.1 time: 0.042686 Aug 03 09:32:46.108639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 136/254] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:32:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:32:46.136617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:46.137477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:46.144941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.145428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.146203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.146644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.205606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-15178407", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-586809750", "security_groups": [{"name": "tempest-secgroup-smoke-1484806263"}], "networks": [{"uuid": "78a1f516-6174-4609-b4be-4705dd9ade5a"}], "block_device_mapping_v2": [{"uuid": "3cc5eabb-fe6c-4e37-bd5c-e4b765ba6046", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:46.319040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:46.328235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-448d34e5-e053-42b7-962b-211d8e5f1258 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.196040 Aug 03 09:32:46.328846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 119/255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:46 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:46.525305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] validate_networks() for [('78a1f516-6174-4609-b4be-4705dd9ade5a', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:32:46.959923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:32:46.960344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:32:46.960825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:32:46.961430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:32:46.961841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:32:46.971614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.972184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.973023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:46.973448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:46.990660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Getting quotas for project c0f1be2882b542668029c26092bd87b7. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:32:46.995358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Getting quotas for user bb2ba828da0f4ea583a7c6e5471bf2df and project c0f1be2882b542668029c26092bd87b7. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:32:47.043246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:47.043862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:47.051116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:47.051978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:47.052891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:47.053481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:47.063633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:32:47.066351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3cc5eabb-fe6c-4e37-bd5c-e4b765ba6046',volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:32:47.213344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f1aea7fc-24a9-4d22-8305-9da31e725857 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.012430 Aug 03 09:32:47.213997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 137/256] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:32:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 09:32:47.235899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a401f3e-cd7b-4505-8c08-025fabaae0d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:47.236836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2a401f3e-cd7b-4505-8c08-025fabaae0d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:47.272708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:47.290924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:47.293829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:47.295101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb6a3ad0-e537-479e-b348-b3894f447e4a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.257006 Aug 03 09:32:47.295667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 120/257] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:47.300022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2a401f3e-cd7b-4505-8c08-025fabaae0d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:47.316176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2a401f3e-cd7b-4505-8c08-025fabaae0d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1086 microversion: 2.1 time: 0.091316 Aug 03 09:32:47.317287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 138/258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1086 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:47.353597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:47.354538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:47.362585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:47.363470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:47.371063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:47.371556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:47.579815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:47.591004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bba9650-9b12-45ef-8b7b-f42c5a7cbaeb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.242529 Aug 03 09:32:47.591899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 121/259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:47 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:48.318979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:48.319505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:48.326330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.326768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.327514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.327937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.336308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:48.337142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:48.343812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.344342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.345154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.345587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.433792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:48.443622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa2aec25-d2ca-4cfe-bceb-eb3f87e577ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1184 microversion: 2.1 time: 0.111291 Aug 03 09:32:48.444435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 122/260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1184 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:48.480234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:48.488573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:48.490120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:48.491286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81cf2ac0-96d6-4dda-a64d-4c85beae3776 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.176306 Aug 03 09:32:48.491846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 139/261] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:48.625339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:48.625954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:48.632458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.632984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.634293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.634727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.792672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "974679dc-5d02-4c05-8bb5-f00ba6fd5522"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:48.795430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:48.801429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.801872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.802636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:48.803063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:48.856048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:48.864793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4d777a54-a55f-4d52-a011-dcb975dc84a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.244282 Aug 03 09:32:48.865658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 123/262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:48 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:49.065910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0824e331-9aaf-4cf6-aa38-b5f40dfd35a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278894 Aug 03 09:32:49.066848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 140/263] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:32:48 2022] POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:32:49.466008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:49.466921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:49.480864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.481663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:49.482340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.482771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:49.518548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:49.519803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:49.539819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.541525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:49.542509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.552437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:49.755483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:49.768295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:49.770685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:49.772388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d15f76c0-ba41-476d-b7f2-95e47c78f37c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.260577 Aug 03 09:32:49.773072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 141/264] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:49.791082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:49.801658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-578e9f54-d431-42dd-a4d2-9a45c1a96e18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1270 microversion: 2.1 time: 0.339468 Aug 03 09:32:49.803125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 124/265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1270 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:49.887488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:49.887819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:49.896218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.896736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:49.897687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:49.898117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:50.050527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:50.061804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dd31519a-ee4e-4f23-a3c3-d6b68bea5945 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.178658 Aug 03 09:32:50.062522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 142/266] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:49 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:50.234238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-b3c96f70-2041-4723-9eab-542bd55e8a55 req-2fce27fd-62d6-4d34-8039-2dce85bf1362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:50.245553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b3c96f70-2041-4723-9eab-542bd55e8a55 req-2fce27fd-62d6-4d34-8039-2dce85bf1362 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:50.246088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b3c96f70-2041-4723-9eab-542bd55e8a55 req-2fce27fd-62d6-4d34-8039-2dce85bf1362 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:50.258877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-b3c96f70-2041-4723-9eab-542bd55e8a55 req-2fce27fd-62d6-4d34-8039-2dce85bf1362 service nova] Creating event network-changed:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:32:50.264684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-b3c96f70-2041-4723-9eab-542bd55e8a55 req-2fce27fd-62d6-4d34-8039-2dce85bf1362 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034738 Aug 03 09:32:50.265396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 125/267] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:32:50.801958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:50.802736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:50.810308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:50.811483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:50.812315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:50.812889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:50.827532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:50.827532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:50.834226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:50.834653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:50.835603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:50.836273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:51.013706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:51.021866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7eeaa15d-e4d7-4604-bfb9-3abbed141f41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1270 microversion: 2.1 time: 0.200143 Aug 03 09:32:51.033100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 126/268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:51.083947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:51.085339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:51.094587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:51.096194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:51.097520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:51.098964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:51.305945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:51.316244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:51.318635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:51.322350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81f3a946-f999-4e4d-9fa6-8ed1cce77c00 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.523796 Aug 03 09:32:51.323786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 143/269] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:51.406303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:51.417327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a81e2d2-e93c-4efd-9ace-082484006511 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.337810 Aug 03 09:32:51.417907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 127/270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:51 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:52.044258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:52.045463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:52.067863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.067863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.067863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.067863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.126825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2dc81507-2916-49fa-b963-386852a9adb6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: .version_select at 0x7fb999595b80>, body: {"keypair": {"name": "tempest-keypair-653932289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0ypNtVp0ed6wssnXzz751q3KKZJjGky41lPFA3Oxbu3KUqvOK72M6qJhqyjHuJPy0EjnvRuzAT3WJvq/Ti+U1bS6QpJWVONzszTzsNQ8GNEE2eq9oxF2sivMQiE1uh+w=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:52.160186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2dc81507-2916-49fa-b963-386852a9adb6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:32:52.172547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-2dc81507-2916-49fa-b963-386852a9adb6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:32:52.214950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2dc81507-2916-49fa-b963-386852a9adb6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091963 Aug 03 09:32:52.226295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:52.226521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 128/271] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:32:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:32:52.235242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-13d59c2f-fc5f-45a2-b080-7b514ef2c08b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.194710 Aug 03 09:32:52.235815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 144/272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:52.346890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:52.347502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:52.354519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.355025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.356340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.356760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.360073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:52.439623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:52.440655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:52.447351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.448115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.448987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:52.449486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:52.625893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:52.636730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:52.645914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cec47c77-bb23-4a57-ace5-d4c9528a1752 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.210231 Aug 03 09:32:52.646493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 145/273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:52 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:52.646792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:52.648326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:52.649572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5c92e5a6-8f98-4cb4-a003-33d78c27cf37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.306906 Aug 03 09:32:52.650131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 129/274] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:53.257602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:53.259216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:53.266458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.267243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.268148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.268845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.592571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:53.605633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca51297e-c202-4f2e-9285-329f35b634e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.351669 Aug 03 09:32:53.619220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 146/275] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:53.667991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:53.668601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:53.695849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:53.697200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:53.706652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:53.708232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.710541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.711078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.711853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.712337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.714275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.715173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:53.715605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:53.727382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:53.926032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:53.935309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b514a5e3-0965-4a13-bc77-3e26d3c230a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.272465 Aug 03 09:32:53.937209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 130/276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:53 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:54.054616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:54.068675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:54.072650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:54.074914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e061ab6c-d3c0-4699-b4fc-57591cb4f300 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.401543 Aug 03 09:32:54.075688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 147/277] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:32:54.241816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1341466561", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b08b9e0-74e3-4321-8eca-779df9e19114"}], "security_groups": [{"name": "tempest-securitygroup--1559569952"}], "key_name": "tempest-keypair-653932289", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:32:54.557334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] validate_networks() for [('1b08b9e0-74e3-4321-8eca-779df9e19114', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:32:54.626788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:54.627402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:54.637927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:54.638373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:54.639151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:54.639582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:54.786586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:54.797830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00cdc505-7a7d-4855-92c8-e71d99fb570a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.174203 Aug 03 09:32:54.798426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 148/278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:54.962959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:54.964211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:54.974272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:54.974731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:54.975509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:54.975967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.137428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:55.146142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cab4d11c-da03-472a-9184-efa1fc47e99f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.187639 Aug 03 09:32:55.156993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 149/279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:54 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:55.166396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:55.166999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:55.172921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.173597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.174545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.175194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.178339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:32:55.179338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:32:55.179894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:32:55.181826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:32:55.182257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:32:55.191518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.191961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.192798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.193252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.212882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:32:55.218277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:32:55.232382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:32:55.235087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:32:55.297875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ec4fc8f-5d97-4316-9450-82f9763e32fe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.059715 Aug 03 09:32:55.298778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 131/280] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:32:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:32:55.313418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-385fa993-fe7a-4a65-b046-cabb59420913 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:55.314027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-385fa993-fe7a-4a65-b046-cabb59420913 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:55.376567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:55.388018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-385fa993-fe7a-4a65-b046-cabb59420913 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:55.388155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:55.390636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:55.392270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d555fc9-c2ef-456c-8375-530379e1c9d4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.233851 Aug 03 09:32:55.401827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-385fa993-fe7a-4a65-b046-cabb59420913 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1241 microversion: 2.1 time: 0.094755 Aug 03 09:32:55.401827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 132/281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:55 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:55.406160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 150/282] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:55.820130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:55.820749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:55.828136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.828353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.829065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:55.829566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:55.996980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.004953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9d888e1e-1717-48e5-89af-73cd9be34344 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.190090 Aug 03 09:32:56.005594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 133/283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:56.172764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:56.173500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:56.181088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.181850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.182713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.183232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.390915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.400214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bafaa4d9-2729-43ae-8409-ea87f3556599 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.230930 Aug 03 09:32:56.401251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 151/284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:56 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:56.421016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:56.423386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:56.426458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:56.426864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:56.442131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.443621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.444031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.445338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.446075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.447709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:56.448659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.452219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:56.531870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.540613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0df0a87-5202-47e2-afb3-b9ed1d952a16 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1293 microversion: 2.1 time: 0.123148 Aug 03 09:32:56.541726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 152/285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:56 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:56.621504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.631527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.633549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:56.634859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-06fb7704-3346-4729-ab12-992f2c32b218 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.221254 Aug 03 09:32:56.635411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 134/286] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:57.026382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:57.026994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:57.029007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:57.034742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.035183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.036156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.036588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.170254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.177691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db9a6f67-7e1c-4a35-a811-ffd2d78bd6b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.155970 Aug 03 09:32:57.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 153/287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:57.424307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:57.424958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:57.434115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.434567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.435851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.436409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.563189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:57.564127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:57.567729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=8 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:57.573843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.574570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.575574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.576219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.585588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.597357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08b6330d-8eee-49e1-9358-272ce04b8b11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.175302 Aug 03 09:32:57.611823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 135/288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:57 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:57.661155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:57.661760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:57.674375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.680602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.685012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f705b62e-d173-4c63-8b69-8bd5e15009af tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1301 microversion: 2.1 time: 0.125592 Aug 03 09:32:57.687107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.687543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 154/289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:57 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1301 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:57.689376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:57.691582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:57.929345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.939218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.941645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:57.942961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa330b3c-740a-486c-ad38-c7152ffb2be7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.285900 Aug 03 09:32:57.943587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 136/290] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:32:58.198864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:58.200014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:58.206136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.206755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.207510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.207932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.354451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:58.362895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2a4b251e-16df-437c-86c6-b3afd7f197ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.168205 Aug 03 09:32:58.363583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 155/291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:58.624760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:58.626251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:58.636250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.637334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.638841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.640318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.717145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:58.718468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:58.730190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.730655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.731453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.731894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.832241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:58.850197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-98de16ce-603a-4292-859c-6b6d534d65fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1311 microversion: 2.1 time: 0.136884 Aug 03 09:32:58.851619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 156/292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:58 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:58.917674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:58.925141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e9c8932f-b9ed-4e26-9124-fb77383a255e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.306607 Aug 03 09:32:58.925710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 137/293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:58 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:32:58.966508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:58.967259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:58.973818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.974523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:58.976351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:58.976793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.160535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:59.170324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:59.171848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:59.173047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0652f8dd-fe28-4510-be96-ad7871003f24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.210480 Aug 03 09:32:59.173803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 157/294] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:32:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:32:59.387614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:59.388317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:59.397933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.398396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.400354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.400988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.662850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:32:59.672221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fed6aca-a797-4714-9ee3-a7e1180f9c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.288956 Aug 03 09:32:59.672910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 138/295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:32:59.871922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:59.872535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:59.879474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.879928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.881119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.881227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.949682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:32:59.950213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:32:59.952290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:32:59.961990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.963217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:32:59.964236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:32:59.965097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.041076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.048988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-71a739de-f818-4234-b658-499f35ec509c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.181057 Aug 03 09:33:00.061108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 158/296] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:59 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:00.068555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a7d4ea9-dda9-44ed-92cc-8a0c1e75d3ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:00.075102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a7d4ea9-dda9-44ed-92cc-8a0c1e75d3ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.075541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a7d4ea9-dda9-44ed-92cc-8a0c1e75d3ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.137550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a7d4ea9-dda9-44ed-92cc-8a0c1e75d3ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Going to try to stop instance {{(pid=117928) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 03 09:33:00.185544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a7d4ea9-dda9-44ed-92cc-8a0c1e75d3ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action" status: 202 len: 0 microversion: 2.1 time: 0.122892 Aug 03 09:33:00.186143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 159/297] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:33:00 2022] POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:33:00.195068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:00.195763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:00.202464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.202907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.203676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.204106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.238749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.260901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-346eb5df-3b5b-48d5-87e6-e4b7ceb04077 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.317865 Aug 03 09:33:00.266643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 139/298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:32:59 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:00.272692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:00.273527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:00.296153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.297287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.299267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.300032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.398350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.408694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e03be320-7f3d-4255-99c7-c724d25f1c36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.218022 Aug 03 09:33:00.409480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 160/299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:00.530327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.541594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.544022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:00.555531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8396f289-6092-45d0-a34c-9974a2513f2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1724 microversion: 2.20 time: 0.286486 Aug 03 09:33:00.557884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 140/300] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:00.655508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1022707227", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:00.698958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:00.700418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:00.723411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] validate_networks() for None {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:33:00.730985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.731769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:00.736168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:00.737722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.009837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.018821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aebe8b07-7a68-4a02-a8d5-c2b030e8d821 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.328345 Aug 03 09:33:01.019475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 141/301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:01.037571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-363d26e9-77cf-42ec-9896-fe9e35c94fea req-503bcfa2-6aff-41c2-a9ef-9dd4ecf6b3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31118185-b7f0-486e-a7d9-6d518fb07d3c", "tag": "271e1ecd-8ee9-4bf4-b59f-05c05fb81716"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:01.047415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-363d26e9-77cf-42ec-9896-fe9e35c94fea req-503bcfa2-6aff-41c2-a9ef-9dd4ecf6b3b6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.047857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-363d26e9-77cf-42ec-9896-fe9e35c94fea req-503bcfa2-6aff-41c2-a9ef-9dd4ecf6b3b6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.063573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-363d26e9-77cf-42ec-9896-fe9e35c94fea req-503bcfa2-6aff-41c2-a9ef-9dd4ecf6b3b6 service nova] Creating event network-changed:271e1ecd-8ee9-4bf4-b59f-05c05fb81716 for instance 31118185-b7f0-486e-a7d9-6d518fb07d3c on hv-cinder-84456 Aug 03 09:33:01.068855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-363d26e9-77cf-42ec-9896-fe9e35c94fea req-503bcfa2-6aff-41c2-a9ef-9dd4ecf6b3b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048066 Aug 03 09:33:01.070235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 142/302] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:01.078100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.078100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.084427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.084936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.085710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.086149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.098262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:33:01.099275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:33:01.099844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:33:01.100343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:33:01.100953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:33:01.112129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.112640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.113537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.113880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.132649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Getting quotas for project a74ec49fc96e46aca644ad8ab3d18700. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:33:01.137592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Getting quotas for user 69b36b3b63e8472d9702ab6215ea664e and project a74ec49fc96e46aca644ad8ab3d18700. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:33:01.149269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:33:01.152234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:33:01.199333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-371df0a4-1a15-4cec-b72e-2a79887afc31 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547885 Aug 03 09:33:01.200306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 161/303] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 09:33:01.210455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f8803f16-26d7-4f36-aad0-c26795bb8781 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.211154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f8803f16-26d7-4f36-aad0-c26795bb8781 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.271853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f8803f16-26d7-4f36-aad0-c26795bb8781 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.282835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f8803f16-26d7-4f36-aad0-c26795bb8781 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1215 microversion: 2.1 time: 0.076055 Aug 03 09:33:01.283721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 162/304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:01.289972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.290948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.297625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.307998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-77006382-82c5-42a5-8626-108d33634164 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.236695 Aug 03 09:33:01.308741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 143/305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:01.324730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.325267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.325998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.326449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.444173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.444779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.451346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.451781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.452542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.453033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.476690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.486522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cc41199e-0cfd-45dd-a933-82bb38286cb0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1500 microversion: 2.1 time: 0.201504 Aug 03 09:33:01.487317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 163/306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:01.509127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c14c9baf-10c6-4ee8-8f4d-d6e6c80ca969"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:01.511622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.518872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.519313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.520276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.520892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.536789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:01.550903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Cannot 'attach_volume' instance 708ec0aa-3818-45fd-9be1-1832b91abdbc while it is in vm_state rescued Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/os-volume_attachments HTTP/1.1 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 74 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:33:01.553037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {"volumeAttachment": {"volumeId": "c14c9baf-10c6-4ee8-8f4d-d6e6c80ca969"}} Aug 03 09:33:01.554359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Cannot 'attach_volume' instance 708ec0aa-3818-45fd-9be1-1832b91abdbc while it is in vm_state rescued Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '708ec0aa-3818-45fd-9be1-1832b91abdbc', 'body': {'volumeAttachment': {'volumeId': 'c14c9baf-10c6-4ee8-8f4d-d6e6c80ca969'}}} Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:33:01.555084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 708ec0aa-3818-45fd-9be1-1832b91abdbc while it is in vm_state rescued Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:33:01.556309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 708ec0aa-3818-45fd-9be1-1832b91abdbc while it is in vm_state rescued Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 409 to user: Cannot 'attach_volume' instance 708ec0aa-3818-45fd-9be1-1832b91abdbc while it is in vm_state rescued {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1a38d704-993a-4c4f-847a-6f5b11921ef1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049679 Aug 03 09:33:01.558003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 164/307] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:33:01 2022] POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 09:33:01.565126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:01.565678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.579767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.580527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.581403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.581988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.628514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.637786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7815d58a-0c86-4294-88c1-588c0df725d4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.197658 Aug 03 09:33:01.638719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 144/308] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:01.643960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.644581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.652151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.652954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.653845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.654273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.660064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-71585ac4-03e5-40a0-abbe-437211543ad3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/action" status: 202 len: 0 microversion: 2.1 time: 0.099234 Aug 03 09:33:01.663983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 165/309] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:33:01 2022] POST /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:33:01.675332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:01.676094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:01.684437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.684927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.685793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:01.686229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:01.814930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.824863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.826687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.828080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f32d5eb-3b14-4ef6-aa01-851a10047d26 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1745 microversion: 2.20 time: 0.188447 Aug 03 09:33:01.828790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 145/310] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:01.841112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:01.842449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0df674e-0cfa-4e0c-831c-b53f38be9441 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1508 microversion: 2.1 time: 0.176876 Aug 03 09:33:01.844846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 166/311] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:01 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:02.039399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.040010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.047391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.048087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.049436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.050021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.067799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-fe7a2c4e-e21e-4f7e-b65f-a223b759add6 req-73e16126-a3e2-4b92-b1de-34b35baa7168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "name": "network-vif-plugged", "status": "completed", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:02.080577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-fe7a2c4e-e21e-4f7e-b65f-a223b759add6 req-73e16126-a3e2-4b92-b1de-34b35baa7168 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.081262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-fe7a2c4e-e21e-4f7e-b65f-a223b759add6 req-73e16126-a3e2-4b92-b1de-34b35baa7168 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.095291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-fe7a2c4e-e21e-4f7e-b65f-a223b759add6 req-73e16126-a3e2-4b92-b1de-34b35baa7168 service nova] Creating event network-vif-plugged:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:33:02.108782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-fe7a2c4e-e21e-4f7e-b65f-a223b759add6 req-73e16126-a3e2-4b92-b1de-34b35baa7168 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045751 Aug 03 09:33:02.110174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 167/312] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:02.218762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:02.226737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-802e37bc-3eb2-4c06-89ce-4378248e4d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.190949 Aug 03 09:33:02.227658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 146/313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:02.304303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.305032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.314844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.316345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.317319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.317592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.329423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.330034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.337780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.338425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.340032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.340705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.413320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:02.421337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-baa7be5d-391e-44c6-b728-a0fa15ab01e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1219 microversion: 2.1 time: 0.121423 Aug 03 09:33:02.421910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 168/314] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:02.476508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:02.483931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-322a0f20-46af-42b9-9b2e-6d230c417352 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.159071 Aug 03 09:33:02.484522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 147/315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:02.659624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.660235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.666344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.666786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.667548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.667982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.807035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:02.816180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5c984435-2837-45f8-9010-f7494e53f26f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.160368 Aug 03 09:33:02.816755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 169/316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:02.851974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.852576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.860528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.861027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.861837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.862449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.863402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:02.864006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:02.865531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:02.870846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.871529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:02.872451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:02.873099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.014919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.027803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8943fd63-ce9a-454d-9d5f-ef1f5f9f069b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1508 microversion: 2.1 time: 0.168061 Aug 03 09:33:03.028697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 170/317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:03.133812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.144255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.145953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.147201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0bd1dae8-2cbf-40ec-b18c-a4eda52558e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1745 microversion: 2.20 time: 0.299282 Aug 03 09:33:03.147841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 148/318] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:33:03.250173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:03.250800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:03.257178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.257624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.258387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.258822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.391829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.400427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a17fe67-895c-4f9d-9685-df6925011611 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.153559 Aug 03 09:33:03.401208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 171/319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:03.445059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:03.448074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:03.461728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.467867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.469194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.470017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.506432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:03.507208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:03.517665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.518283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.519890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.520716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.796396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.803188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:03.806840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4992cfb9-0871-4b5c-8fad-fa420253c82a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.305182 Aug 03 09:33:03.822184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 172/320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:03 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:03.823625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2e3625d0-43c3-47f3-b88a-afbaf0eab18c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1267 microversion: 2.1 time: 0.382358 Aug 03 09:33:03.828971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 149/321] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:03 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1267 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:03.846731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:03.847340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:03.863194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.867539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:03.870807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:03.871438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.050777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:04.051944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:04.061727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.065058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.067598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.069197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.100368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:04.112117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c969cda6-b0bd-44bd-9038-76343fc9ba47 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.269583 Aug 03 09:33:04.113583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 173/322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:04.172428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:04.173142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:04.184826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.186844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.188801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.189274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.467382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:04.475558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:04.477105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:04.478514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f01ddb0-ed0d-47e6-a48b-212e609955ec tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1745 microversion: 2.20 time: 0.310502 Aug 03 09:33:04.493018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 174/323] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1745 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:33:04.501077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-cb10d5c7-d57e-423f-8e02-4cc23bc5892c req-04934d9e-c8a8-4f6b-8c92-9567e26b6d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "name": "network-vif-plugged", "status": "completed", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:04.511613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-cb10d5c7-d57e-423f-8e02-4cc23bc5892c req-04934d9e-c8a8-4f6b-8c92-9567e26b6d71 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.512292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-cb10d5c7-d57e-423f-8e02-4cc23bc5892c req-04934d9e-c8a8-4f6b-8c92-9567e26b6d71 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.523911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-cb10d5c7-d57e-423f-8e02-4cc23bc5892c req-04934d9e-c8a8-4f6b-8c92-9567e26b6d71 service nova] Creating event network-vif-plugged:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:33:04.529270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-cb10d5c7-d57e-423f-8e02-4cc23bc5892c req-04934d9e-c8a8-4f6b-8c92-9567e26b6d71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033954 Aug 03 09:33:04.530543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 175/324] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:04.534981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:04.535485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:04.536176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:04.542619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.543272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.543395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ce8c12e-c333-4a1d-9988-106d854c24fb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1508 microversion: 2.1 time: 0.497347 Aug 03 09:33:04.544168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 150/325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:04 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1508 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:04.545328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.545947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.830378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:04.831109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:04.837495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.838987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:04.838987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:04.839632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.005280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.019123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c32d26e0-36f5-4074-8e55-96bbd45926d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1258 microversion: 2.1 time: 0.486830 Aug 03 09:33:05.021036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 176/326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1258 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:05.041394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:05.048791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:05.057926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.058365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.059165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.059540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.086197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.108274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de39dec1-b1c1-4497-9d0f-34da6afb36a0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.281924 Aug 03 09:33:05.120311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 151/327] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:04 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:05.134230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:05.136481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:05.150099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.152203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.153147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.159738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.202169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:05.375981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.387271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a673d873-e981-4bf6-a20f-486465a91517 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.349700 Aug 03 09:33:05.387891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 177/328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:05 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:05.396326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=12 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:05.419670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.428420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a37407f-de14-4759-a681-b38e9a964ce5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.298105 Aug 03 09:33:05.429733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 152/329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:05.506320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:05.506923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:05.521032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.522703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.524724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.525202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.575600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:05.579743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:05.585960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.586649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.589519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:05.590146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:05.721960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.737597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.741079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.747527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f2ee098-11ef-427a-870c-824116181ac6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.245186 Aug 03 09:33:05.748362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 178/330] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:05.786759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:05.796774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f52a5e4-eac8-4439-9991-c7fed6e7c8ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1508 microversion: 2.1 time: 0.227059 Aug 03 09:33:05.798096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 153/331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:05 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:06.042816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.043774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.083743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.084535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.085576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.086215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.139050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.139656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.153067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.153788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.154755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.155523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.374214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:06.375798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:06.387049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67bda2a5-028e-4866-9c50-f0ea7b98a797 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.251664 Aug 03 09:33:06.388141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 154/332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:06.404458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-64da595c-2812-4cb6-a1cd-26462c401747 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1442 microversion: 2.1 time: 0.365792 Aug 03 09:33:06.405080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 179/333] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1442 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:06.417408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.418018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.425443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.426296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.427247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.427817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.430985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.431715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.441008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.442310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.443217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.443816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.688462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:06.696183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a9bf7a5-27f2-49ab-9e85-6882370d4da8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.283197 Aug 03 09:33:06.709503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 155/334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:06.716002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.716612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.723213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.723587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.724487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.725125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.852464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:06.862762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-705bea68-042b-40ab-8a65-5b2d4ff8da70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1442 microversion: 2.1 time: 0.435593 Aug 03 09:33:06.873393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 180/335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1442 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:06.878732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-29b55004-a488-45dd-baf1-91e2d7992f93 req-22b2e22e-8eeb-4007-acc3-b577d221a167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31118185-b7f0-486e-a7d9-6d518fb07d3c", "name": "network-vif-plugged", "status": "completed", "tag": "271e1ecd-8ee9-4bf4-b59f-05c05fb81716"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:06.900270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-29b55004-a488-45dd-baf1-91e2d7992f93 req-22b2e22e-8eeb-4007-acc3-b577d221a167 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.904302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-29b55004-a488-45dd-baf1-91e2d7992f93 req-22b2e22e-8eeb-4007-acc3-b577d221a167 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.936802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-29b55004-a488-45dd-baf1-91e2d7992f93 req-22b2e22e-8eeb-4007-acc3-b577d221a167 service nova] Creating event network-vif-plugged:271e1ecd-8ee9-4bf4-b59f-05c05fb81716 for instance 31118185-b7f0-486e-a7d9-6d518fb07d3c on hv-cinder-84456 Aug 03 09:33:06.947189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-29b55004-a488-45dd-baf1-91e2d7992f93 req-22b2e22e-8eeb-4007-acc3-b577d221a167 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071587 Aug 03 09:33:06.953999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 181/336] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:06.960764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:06.967815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:06.985445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.985445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:06.985445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:06.985445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.001980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.016882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e135175f-673f-433c-b1fe-89215c8b3213 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.306075 Aug 03 09:33:07.018371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 156/337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:07.049782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:07.050548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:07.072200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.072649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.085475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.085885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.086231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:07.392512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.408980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0b7b648-6f64-4129-bab2-f5aba810ad4f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1508 microversion: 2.1 time: 0.380025 Aug 03 09:33:07.409582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 157/338] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:07 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:07.414301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-155e06e6-4f5a-4865-bd70-6d64e597332b req-4438af2c-129c-4174-b135-3f1504343983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "852270a7-7f6b-4501-b3cd-4692a389f356", "tag": "853bbfe0-dc69-4fa1-93cc-18684c7ab454"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:07.439057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-155e06e6-4f5a-4865-bd70-6d64e597332b req-4438af2c-129c-4174-b135-3f1504343983 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.445061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.446742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-155e06e6-4f5a-4865-bd70-6d64e597332b req-4438af2c-129c-4174-b135-3f1504343983 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.458254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.459986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.463405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f7d5a28-723d-4f74-8bef-6bf501709d2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.507738 Aug 03 09:33:07.463976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 182/339] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:07.469999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:07.470839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:07.476344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-155e06e6-4f5a-4865-bd70-6d64e597332b req-4438af2c-129c-4174-b135-3f1504343983 service nova] Creating event network-changed:853bbfe0-dc69-4fa1-93cc-18684c7ab454 for instance 852270a7-7f6b-4501-b3cd-4692a389f356 on hv-cinder-84456 Aug 03 09:33:07.479755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.480491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.482143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.482775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.490945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-155e06e6-4f5a-4865-bd70-6d64e597332b req-4438af2c-129c-4174-b135-3f1504343983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078252 Aug 03 09:33:07.494053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 158/340] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:07.663351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:07.671660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c055de01-d082-4d87-b199-14026cd9a61c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.205763 Aug 03 09:33:07.689255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 183/341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:07 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:07.723512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:07.724759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:07.732587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.733077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:07.733979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:07.734580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.006514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.023065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9fef27b8-b01e-4c0c-976b-14099950f828 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.305542 Aug 03 09:33:08.025780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 159/342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:07 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:08.039860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:08.041322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:08.063541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.063541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.063541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.063541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.430556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.430818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:08.432037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:08.439931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c525d87-910c-4d15-80bd-74b65c41317f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.404122 Aug 03 09:33:08.443076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.443277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 184/343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:08.444904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.445904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.447114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.488741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:08.489495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:08.496879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.497450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.498320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.498856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.658833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.671343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.676877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.678514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21881fe6-84be-4f70-9e0e-5a5d0f2a2706 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.193732 Aug 03 09:33:08.679183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 185/344] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:33:08.698763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:08.700130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:08.711117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.711712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.716264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:08.716902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:08.846522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:08.856095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f019527f-ab7b-49e5-9298-22cb42429b91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1514 microversion: 2.1 time: 0.429857 Aug 03 09:33:08.859958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 160/345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:08 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1514 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:08.988407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:09.008012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7fe9705-1798-4a8d-a1d3-7038f3ff412b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.315145 Aug 03 09:33:09.022867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 186/346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:08 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:09.047114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:09.047820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:09.061787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.062243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:09.063028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.063462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:09.465894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:09.466587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:09.489343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.490161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:09.491250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.491845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:09.496423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:09.516648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bea1b378-f24c-43a8-81fa-04cd3aaed085 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.471016 Aug 03 09:33:09.520680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 161/347] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:09 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:09.652431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:09.660486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b0f6469e-560e-49d9-8f34-18a4ec9fcaf2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.198648 Aug 03 09:33:09.661095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 187/348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:09.704050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:09.705064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:09.711818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.713306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:09.714351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:09.716078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.029031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:10.030110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:10.039699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.041543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.042794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.043550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.223712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:10.236666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-167f9f5e-5c47-4898-8c18-0aca00f891d9 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1367 microversion: 2.1 time: 0.211787 Aug 03 09:33:10.238205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 188/349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:10 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:10.495644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:10.510965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:10.512472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:10.513661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c7b836a-cecf-445e-9d1b-e0ecc153e959 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.813825 Aug 03 09:33:10.525112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 162/350] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:10.539419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:10.539934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:10.543099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:10.548549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.549059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.550028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.550624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.620304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd319e05-cb49-433e-b16e-5ab8aca84624 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: .version_select at 0x7fb999640af0>, body: {"keypair": {"name": "tempest-keypair-513999002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZufcBqZTCMhAZsdXHsroJwq4OMa8juo+ihUZCXzmZcyzBuecLW6IbC6L7PSzb7R8uTAWbuHjzNu3e0/GIQxXihUt9UhfJzaXG0yeTBRTLkZi80J/mwRiJO2RdDP9T+7w=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:10.674517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-dd319e05-cb49-433e-b16e-5ab8aca84624 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:33:10.683082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-dd319e05-cb49-433e-b16e-5ab8aca84624 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for user f366a30f465b4dbea0dfa9a8e5f0a15c and project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:33:10.722185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd319e05-cb49-433e-b16e-5ab8aca84624 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108115 Aug 03 09:33:10.730642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 163/351] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:33:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:10.737168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:10.738021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:10.751249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.751868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.753030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.753631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.763789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:10.772152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-79148da1-fca1-4d60-a51a-3d101d001813 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.236595 Aug 03 09:33:10.772728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 189/352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:10 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:10.869552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-e2282272-5e38-4f85-99e4-168777594430 req-5924a6f5-c474-43b0-a134-f76790cc4393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:10.885950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e2282272-5e38-4f85-99e4-168777594430 req-5924a6f5-c474-43b0-a134-f76790cc4393 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:10.897275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e2282272-5e38-4f85-99e4-168777594430 req-5924a6f5-c474-43b0-a134-f76790cc4393 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:10.909103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-e2282272-5e38-4f85-99e4-168777594430 req-5924a6f5-c474-43b0-a134-f76790cc4393 service nova] Creating event network-changed:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:33:10.922499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-e2282272-5e38-4f85-99e4-168777594430 req-5924a6f5-c474-43b0-a134-f76790cc4393 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057091 Aug 03 09:33:10.923379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 190/353] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:11.050786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:11.081014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db3cde3e-72e1-4ffd-b474-5b6e54ff61de tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.345962 Aug 03 09:33:11.085526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 164/354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:11.257240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:11.264851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:11.265943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:11.279475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=8 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:11.283873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.285919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.286803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.288855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.544549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:11.545431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:11.567271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.570539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.577296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.579820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.629529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:11.644506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce8a7b3d-9bd1-44ac-8947-c056221698cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1558 microversion: 2.1 time: 0.388539 Aug 03 09:33:11.645136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 191/355] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:11 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1558 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:11.669312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:11.670112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:11.685247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.685711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.687605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.688256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.874566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29d42bde-ed38-4b34-85b9-12063fd80166 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209708 Aug 03 09:33:11.875830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 192/356] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:33:11 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/os-interface => generated 285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:11.881611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:11.882664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:11.898172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.900498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.902280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:11.903131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:11.903635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:11.913010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:11.917303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:11.919481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5699b30-3f2e-4c76-bf3c-63e6c42dfd66 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.380245 Aug 03 09:33:11.920120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 165/357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:12.108034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:12.108864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:12.119449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:12.121376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:12.122603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:12.126894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:12.172085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:12.509823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:12.521493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-455d3b8f-2c1d-4ca0-b0a2-2b00345de28d tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.644227 Aug 03 09:33:12.523493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 193/358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:11 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:12.608334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:12.619584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62e96f1c-fb58-4bc2-abb2-db6a1e99c0e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.515716 Aug 03 09:33:12.626694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 166/359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:12.949968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:12.950601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:12.961701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:12.968455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:12.971909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:12.972346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:13.551781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:13.553105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:13.570043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:13.574541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:13.575818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:13.578202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:13.770352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:13.781542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:13.783074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:13.784263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b6ac47d-bd37-4809-8c50-f026087bd250 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.840713 Aug 03 09:33:13.784841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 194/360] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:13.789249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:13.789858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:13.813265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:13.813948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:13.814982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:13.815650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:13.992622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:14.014528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a61f3384-cddc-46bf-98df-01b6ce8de28e tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.471512 Aug 03 09:33:14.015161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 167/361] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:13 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:14.146936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1911997761", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eb1b7df0-9151-4a05-b278-939fa226e4f3"}], "security_groups": [{"name": "tempest-securitygroup--2146439852"}], "key_name": "tempest-keypair-513999002", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:14.390963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] validate_networks() for [('eb1b7df0-9151-4a05-b278-939fa226e4f3', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:33:14.408315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:14.437769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b31e4ea-7e33-4d99-a30d-d6d3fd2930c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.651803 Aug 03 09:33:14.438662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 195/362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:14.674032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-09e7acb3-d394-44ca-b606-842b333ea70f req-1895af78-e9dd-4462-a25b-0ef849d0db61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31118185-b7f0-486e-a7d9-6d518fb07d3c", "tag": "271e1ecd-8ee9-4bf4-b59f-05c05fb81716"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:14.688379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-09e7acb3-d394-44ca-b606-842b333ea70f req-1895af78-e9dd-4462-a25b-0ef849d0db61 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:14.688841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-09e7acb3-d394-44ca-b606-842b333ea70f req-1895af78-e9dd-4462-a25b-0ef849d0db61 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:14.702232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-09e7acb3-d394-44ca-b606-842b333ea70f req-1895af78-e9dd-4462-a25b-0ef849d0db61 service nova] Creating event network-changed:271e1ecd-8ee9-4bf4-b59f-05c05fb81716 for instance 31118185-b7f0-486e-a7d9-6d518fb07d3c on hv-cinder-84456 Aug 03 09:33:14.707757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-09e7acb3-d394-44ca-b606-842b333ea70f req-1895af78-e9dd-4462-a25b-0ef849d0db61 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037517 Aug 03 09:33:14.708565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 196/363] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:14.819905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:14.822439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:14.845109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:14.846291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:14.849363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:14.852030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.168314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:33:15.169834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:33:15.170511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:33:15.171111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:33:15.171715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:33:15.198380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.199749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.205359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.211914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.308053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:33:15.318088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Getting quotas for user f366a30f465b4dbea0dfa9a8e5f0a15c and project 79dda421f5ac471e8096942dcc4cedf5. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:33:15.332994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:33:15.335562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:33:15.391712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9d984f4b-a676-44c7-88da-15a5ef60bab1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.249780 Aug 03 09:33:15.394049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 168/364] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:33:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 09:33:15.406660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:15.407556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:15.422008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.423278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.424693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.425292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.504003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:15.527984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:15.530000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:15.539770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b958d4bb-d544-4b39-b976-c92713ce7687 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.732892 Aug 03 09:33:15.545273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 197/365] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:15.579228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-548cae34-4607-4dae-bc4e-f8e64e3a9a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:15.586584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-548cae34-4607-4dae-bc4e-f8e64e3a9a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:15.753550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:15.761750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-344f6df3-95ed-4114-9c22-0973d67329e5 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.366448 Aug 03 09:33:15.762601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 169/366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:15 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:15.782096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:15.783041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:15.789766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.790218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.792006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:15.792539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:15.805940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-548cae34-4607-4dae-bc4e-f8e64e3a9a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:15.817846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-548cae34-4607-4dae-bc4e-f8e64e3a9a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1245 microversion: 2.1 time: 0.256954 Aug 03 09:33:15.818606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 198/367] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1245 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:16.040660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:16.052295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1a5410f4-7282-4fa6-92e0-f29bdf881b6c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.277854 Aug 03 09:33:16.068174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 170/368] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:16.572024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:16.573447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:16.581242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.582056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:16.583073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.583747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:16.758932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:16.770233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:16.771968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:16.773457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-90c9c14a-b359-462a-bd80-f88bde221547 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.205725 Aug 03 09:33:16.774461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 199/369] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:16.787155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:16.788960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:16.804608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.812859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:16.813811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.814783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:16.840976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:16.842017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:16.854379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.855037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:16.856513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:16.867959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:17.001953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:17.016249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0cd33c6d-00b5-48ea-a981-60909d2da522 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.233416 Aug 03 09:33:17.017083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 171/370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:16 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:17.027189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-830ac376-6396-4f84-8f78-2124a3123a24 req-6bd93260-2dd2-498d-8555-7959b9588a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852270a7-7f6b-4501-b3cd-4692a389f356", "name": "network-vif-plugged", "status": "completed", "tag": "853bbfe0-dc69-4fa1-93cc-18684c7ab454"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:17.061475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-830ac376-6396-4f84-8f78-2124a3123a24 req-6bd93260-2dd2-498d-8555-7959b9588a8e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:17.061918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-830ac376-6396-4f84-8f78-2124a3123a24 req-6bd93260-2dd2-498d-8555-7959b9588a8e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:17.063043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:17.085717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-830ac376-6396-4f84-8f78-2124a3123a24 req-6bd93260-2dd2-498d-8555-7959b9588a8e service nova] Creating event network-vif-plugged:853bbfe0-dc69-4fa1-93cc-18684c7ab454 for instance 852270a7-7f6b-4501-b3cd-4692a389f356 on hv-cinder-84456 Aug 03 09:33:17.092875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-830ac376-6396-4f84-8f78-2124a3123a24 req-6bd93260-2dd2-498d-8555-7959b9588a8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073585 Aug 03 09:33:17.095977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 172/371] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:17.108472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fd766e34-fd9c-4460-8d99-f1b7017d7533 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1297 microversion: 2.1 time: 0.267155 Aug 03 09:33:17.115541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:17.119138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:17.126418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 200/372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1297 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:17.128349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:17.128797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:17.129589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:17.130020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:17.324339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:17.337512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-807e893b-da56-4504-a75f-aa9e57c8e27d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.233653 Aug 03 09:33:17.338306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 173/373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:17.811875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:17.813474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:17.829704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:17.830727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:17.832268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:17.834070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.037967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:18.038691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:18.066216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.066984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.068650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.069309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.097213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.100004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:18.114161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.121328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.123141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e5bcb902-5b94-4e5b-a2f5-7e6fa05dcb15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.326965 Aug 03 09:33:18.137003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 201/374] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:18.145568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:18.146429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:18.153858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.154559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.155485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.156065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.269862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.283316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d0db4472-7433-4192-8cda-9c62650c62bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1303 microversion: 2.1 time: 0.144907 Aug 03 09:33:18.285727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.286982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 202/375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:18.311905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-13f859ee-d09a-44bf-ba03-2e23cbdabbcb tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1315 microversion: 2.1 time: 0.277726 Aug 03 09:33:18.317380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 174/376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:18 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:18.362371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:18.362371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:18.371276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.371852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.372730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:18.373355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:18.596799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:18.606419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9ee6ce7-6be3-411b-9860-794611456e16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.250301 Aug 03 09:33:18.611468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 203/377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:19.152269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.156485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.165959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.166505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.167915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.168420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.311390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.312010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.321404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.321879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.322658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.323094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.366282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.391759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.396401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.400248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcd49fb4-9707-4ac7-a856-f826284dffd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.254007 Aug 03 09:33:19.401886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 175/378] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:19.412148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.414934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.421288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:19.433717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.434465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.435421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.436013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.595458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.604776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.607688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8aac5682-1990-4fab-9165-a6569eae4e76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.300776 Aug 03 09:33:19.614364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-79cf6f9a-50fb-426d-8829-8f8b148b8689 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1464 microversion: 2.1 time: 0.208346 Aug 03 09:33:19.621171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 204/379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:19.628871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.629898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 176/380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:19 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:19.630765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.644161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.644613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.645419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.645852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.667945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.668535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.675238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.675814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.676757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.677315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.717669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:33:19.832574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:19.848117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-470bcae6-afae-4ad7-a23f-121e6d229972 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "DELETE /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 204 len: 0 microversion: 2.1 time: 0.186115 Aug 03 09:33:19.849106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 177/381] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:33:19 2022] DELETE /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:33:19.849545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-977bcc6a-e637-4d39-a3e1-8288dcda4be6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.224180 Aug 03 09:33:19.850125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 205/382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:19.857555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:19.858242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:19.864271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.864706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.866150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.866751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:19.982241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-dd50d999-f518-476a-943f-54cbd3956535 req-d2d6b28b-c116-4760-b073-4f97c0b7488e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:19.999023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dd50d999-f518-476a-943f-54cbd3956535 req-d2d6b28b-c116-4760-b073-4f97c0b7488e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:19.999468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dd50d999-f518-476a-943f-54cbd3956535 req-d2d6b28b-c116-4760-b073-4f97c0b7488e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.026046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-dd50d999-f518-476a-943f-54cbd3956535 req-d2d6b28b-c116-4760-b073-4f97c0b7488e service nova] Creating event network-changed:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 09:33:20.031818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-dd50d999-f518-476a-943f-54cbd3956535 req-d2d6b28b-c116-4760-b073-4f97c0b7488e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060456 Aug 03 09:33:20.032414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 206/383] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:20.048603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:20.092058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-209fe564-41e8-4190-9bd9-db56667743c8 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1470 microversion: 2.1 time: 0.204335 Aug 03 09:33:20.094472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 178/384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:19 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:20.424133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:20.424853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:20.431688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.432131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.432953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.433390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.565448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:20.574670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:20.576239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:20.577462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f0b40917-d057-40cc-8f97-7bf8896e2d6e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.157663 Aug 03 09:33:20.578023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 207/385] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:20.630938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:20.631591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:20.638647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.639105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.639899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.640367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.777301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:20.784789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aef67b93-375e-4d39-a2c7-954b517b3e5e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.157598 Aug 03 09:33:20.785382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 179/386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:20.870556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:20.871237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:20.877385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.877826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:20.878574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:20.878998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.007026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.015063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5253a81-f91f-42b5-8108-18ada962415a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.148499 Aug 03 09:33:21.015625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 208/387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:21.115101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:21.115707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:21.121897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.122343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.123096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.123532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.260268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.267767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-82018125-13f5-41a2-a54d-7e64698d0632 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1470 microversion: 2.1 time: 0.156509 Aug 03 09:33:21.268536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 180/388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:21 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:21.601887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:21.602504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:21.609207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.609652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.610406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.610834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.797916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.805919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:21.807532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:21.807730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.809272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.810438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84b850c4-b425-4ff7-b480-235fab7a6e59 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1740 microversion: 2.20 time: 0.213103 Aug 03 09:33:21.811127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 209/389] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:21.814516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.814960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.815749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:21.816184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:21.949935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:21.957164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f40e0ff-f3a1-4d79-83cb-b5adc22e289d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.155069 Aug 03 09:33:21.957722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 181/390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:22.038936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:22.039542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:22.046105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.046586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.047344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.047783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.265129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:22.282456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad7ec266-3b45-4d2f-bd09-43152452942f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1724 microversion: 2.1 time: 0.246777 Aug 03 09:33:22.283389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 210/391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:22.290810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:22.291750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:22.298532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.299323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.300485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.301049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.440146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:22.442657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:22.450217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a6051d2e-3a8c-4e42-8d09-50dc74a21ab0 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1470 microversion: 2.1 time: 0.164101 Aug 03 09:33:22.450786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 182/392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:22 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:22.835121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:22.837016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:22.844537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.845028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.845810 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.846284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.955101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-95b9e57d-d167-48e2-bea9-085b31607f6b req-c96ab9fe-4a84-4254-ab01-ece6cd9d2b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "852270a7-7f6b-4501-b3cd-4692a389f356", "name": "network-vif-deleted", "tag": "853bbfe0-dc69-4fa1-93cc-18684c7ab454"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:22.967799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-95b9e57d-d167-48e2-bea9-085b31607f6b req-c96ab9fe-4a84-4254-ab01-ece6cd9d2b59 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:22.968472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-95b9e57d-d167-48e2-bea9-085b31607f6b req-c96ab9fe-4a84-4254-ab01-ece6cd9d2b59 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:22.986174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-95b9e57d-d167-48e2-bea9-085b31607f6b req-c96ab9fe-4a84-4254-ab01-ece6cd9d2b59 service nova] Creating event network-vif-deleted:853bbfe0-dc69-4fa1-93cc-18684c7ab454 for instance 852270a7-7f6b-4501-b3cd-4692a389f356 on hv-cinder-84456 Aug 03 09:33:22.991372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-95b9e57d-d167-48e2-bea9-085b31607f6b req-c96ab9fe-4a84-4254-ab01-ece6cd9d2b59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039774 Aug 03 09:33:22.991976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 183/393] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:22.998116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:22.998822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:23.005830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.006281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.007057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.007681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.027420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.037416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.039159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.040362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f416f5c0-da12-4776-8fb2-e4142d62f2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1722 microversion: 2.20 time: 0.209230 Aug 03 09:33:23.041151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 211/394] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:23.179637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.189704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-515a251e-f105-4489-b343-e6d0f4f30b0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.196354 Aug 03 09:33:23.190300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 184/395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:23.304667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:23.305355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:23.312556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.313050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.313851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.314369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.471953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:23.472606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:23.481374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.482615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.483682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.484225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.488033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.496550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5921397-a820-499a-8512-570199a714d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1701 microversion: 2.1 time: 0.195910 Aug 03 09:33:23.497421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 212/396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1701 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:23.517112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-78554307-6f52-487f-a2c3-d7ed46e13e3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:23.523336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78554307-6f52-487f-a2c3-d7ed46e13e3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.523783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78554307-6f52-487f-a2c3-d7ed46e13e3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.551206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-78554307-6f52-487f-a2c3-d7ed46e13e3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Going to try to start instance {{(pid=117928) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 03 09:33:23.553559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.562174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-888df684-c516-44d2-b223-e2b7e9c6e320 tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1428 microversion: 2.1 time: 0.094020 Aug 03 09:33:23.562753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 185/397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:23 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:23.597238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-78554307-6f52-487f-a2c3-d7ed46e13e3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action" status: 202 len: 0 microversion: 2.1 time: 0.083678 Aug 03 09:33:23.597848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 213/398] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:33:23 2022] POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 09:33:23.609004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:23.610192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:23.616930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.617372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.618154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:23.619163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:23.793575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:23.802587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-434b0ca6-7875-4fdf-8bed-c5a2f15236a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1710 microversion: 2.1 time: 0.200128 Aug 03 09:33:23.803522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 186/399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:24.072648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:24.073441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:24.083886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.084431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.086354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.086875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.218049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:24.218918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:24.227236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.227790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.228965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.229521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.425635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:24.435286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:24.436982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:24.438138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8fc64c4a-1d04-4342-8cd9-6ff008695ca5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1722 microversion: 2.20 time: 0.371788 Aug 03 09:33:24.438710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 214/400] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1722 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:24.505295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:24.513202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2fe1703-af0f-47d5-96b7-bae376f6b3d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.299598 Aug 03 09:33:24.513788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 187/401] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:24.586556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:24.588184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:24.598543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.602137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.603196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.603821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.643044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.643642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.644230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lazy-loading 'fault' on Instance uuid 852270a7-7f6b-4501-b3cd-4692a389f356 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:33:24.700404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69b36b3b63e8472d9702ab6215ea664e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a74ec49fc96e46aca644ad8ab3d18700', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:24.708021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-221f9823-ec7e-4698-b84f-e66fcad8533a tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 200 len: 1305 microversion: 2.1 time: 0.125440 Aug 03 09:33:24.709071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 215/402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:24 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:24.830820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:24.831421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:24.838249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.838700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:24.839612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:24.840110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.012608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:25.024022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-94ca4954-5e24-41ba-a3a6-d938f5846a3a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1710 microversion: 2.1 time: 0.196923 Aug 03 09:33:25.031073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 188/403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:25.464034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:25.464644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:25.470992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.471432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.472194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.472616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.534015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:25.534623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:25.536607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:25.537848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=10 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:25.544973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.545416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.546181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.546606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.618068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:25.626624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:25.628106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:25.629272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4880be7-6984-4e3c-99c1-e94d30a6ce08 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1722 microversion: 2.20 time: 0.171678 Aug 03 09:33:25.629822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 216/404] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:33:25.685752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:25.693280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8484a745-9aae-4aec-852f-975ea392002f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.163055 Aug 03 09:33:25.693837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 189/405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:25.731469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:25.732230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] [instance: 852270a7-7f6b-4501-b3cd-4692a389f356] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:25.738013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.738452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.739204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:25.739635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:25.752766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] HTTP exception thrown: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Request method failure captured: Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 HTTP/1.1 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kDKP13VCj32p5J0_TiZDwWzJqg5K9YD3_TSttaxnC4a5D1uWi4h_7gTQ3uXg8HTmx2NlWG5cobEIMPdMoKc_80muFrykpMzD2dhgmb0VyvOLJWXx4REUeiBK9vHp0Nq_Ynez9zSIRfzSC_RoHaJF_6BSF8cBLGmP_vorovQQT2JFdQ Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: a74ec49fc96e46aca644ad8ab3d18700 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-450190909 Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:33:25.754408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/a74ec49fc96e46aca644ad8ab3d18700"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a74ec49fc96e46aca644ad8ab3d18700"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_a74ec49fc96e46aca644ad8ab3d18700"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/a74ec49fc96e46aca644ad8ab3d18700"}]}] Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-450190909 Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: a74ec49fc96e46aca644ad8ab3d18700 Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-450190909 Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-450190909-project Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 69b36b3b63e8472d9702ab6215ea664e Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-450190909-project Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. Aug 03 09:33:25.755945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '852270a7-7f6b-4501-b3cd-4692a389f356'} Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:33:25.757472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. Aug 03 09:33:25.758873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:33:25.761050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] Returning 404 to user: Instance 852270a7-7f6b-4501-b3cd-4692a389f356 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:33:25.761050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5166539c-d9df-4dcc-b774-f60ce4e1712c tempest-VolumesNegativeTest-450190909 tempest-VolumesNegativeTest-450190909-project] 10.222.0.20 "GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356" status: 404 len: 111 microversion: 2.1 time: 0.028976 Aug 03 09:33:25.761050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 217/406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:25 2022] GET /compute/v2.1/servers/852270a7-7f6b-4501-b3cd-4692a389f356 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:33:26.047044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:26.047658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:26.054150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.054626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.055408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.055845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.204543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:26.213859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8ab195e5-3db0-4a16-b9fa-d3a1682fd454 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1710 microversion: 2.1 time: 0.170684 Aug 03 09:33:26.214605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 190/407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:26.653091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:26.653699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:26.655663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:26.661440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.661887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.662650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.663086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.679087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:26.715384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:26.716006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:26.723188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.723802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.724684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:26.725262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:26.817304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:26.829674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:26.831463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:26.833043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-49fc1099-4045-4f9a-abe7-4b5e78af2ed9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1722 microversion: 2.20 time: 0.184243 Aug 03 09:33:26.833772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 218/408] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:26.896697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:26.904856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e92d036-a5ea-4c1f-9d61-daaf5832ade2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.193521 Aug 03 09:33:26.905713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 191/409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:27.019675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-c84e12ac-79ff-4b59-8ced-454006260c1a req-ac968d4d-8fa6-42be-8b8c-73ad42882d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "name": "network-vif-unplugged", "status": "completed", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:27.033520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-c84e12ac-79ff-4b59-8ced-454006260c1a req-ac968d4d-8fa6-42be-8b8c-73ad42882d95 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.034248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-c84e12ac-79ff-4b59-8ced-454006260c1a req-ac968d4d-8fa6-42be-8b8c-73ad42882d95 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.047839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-c84e12ac-79ff-4b59-8ced-454006260c1a req-ac968d4d-8fa6-42be-8b8c-73ad42882d95 service nova] Creating event network-vif-unplugged:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:33:27.053511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-c84e12ac-79ff-4b59-8ced-454006260c1a req-ac968d4d-8fa6-42be-8b8c-73ad42882d95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037847 Aug 03 09:33:27.054102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 219/410] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:27.235065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:27.235684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:27.243213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.244713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.245956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.246461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.392240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:27.401877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f4e8e6e9-80fe-499a-80a7-3050266fb0e3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1710 microversion: 2.1 time: 0.170568 Aug 03 09:33:27.402701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 192/411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:27.858121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:27.858812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:27.866643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.866915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.867676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.868111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.927582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:27.928290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:27.936530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.937077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:27.937857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:27.938296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.022359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.035591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.037524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.039157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7452d470-7c12-4942-a8fd-80e2d8f6b4b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1725 microversion: 2.20 time: 0.185765 Aug 03 09:33:28.040259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 220/412] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:28.070947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2918f67e-0782-49e1-889d-1b8184699478"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:28.076713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:28.084468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.085388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.086171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.086597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.108474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.116677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a371fa93-5a7c-417a-9c4f-a36b7d1cbcbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.192345 Aug 03 09:33:28.117299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 193/413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:28.398637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ac6d1ef-905f-437d-9a8f-84c4664325be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335764 Aug 03 09:33:28.399592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 221/414] 10.222.0.20 () {62 vars in 1364 bytes} [Wed Aug 3 09:33:28 2022] POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:33:28.423560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:28.424170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:28.430199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.430649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.431569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.431877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.565588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:28.566248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:28.578349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.579668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.580529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.581073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.583535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.592977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-800aa235-c09f-4acc-83ba-3bdb4f24d78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1710 microversion: 2.1 time: 0.173255 Aug 03 09:33:28.593559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 194/415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:28.660281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117928) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 03 09:33:28.754679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b8d8f6f0-d8b2-410b-a7f1-aefe672910f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action" status: 202 len: 0 microversion: 2.20 time: 0.197686 Aug 03 09:33:28.755228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 222/416] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 3 09:33:28 2022] POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 09:33:28.764290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:28.764926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:28.771050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.771501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.772283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:28.772838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:28.928896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.939209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.941064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:28.942242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-44af3989-4824-41fe-b801-cabadc105986 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1751 microversion: 2.20 time: 0.182730 Aug 03 09:33:28.942804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 195/417] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:29.069908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-dc366f57-110b-4143-8038-43209ee42f9c req-4edcd0eb-6d73-4c9b-8630-a262749292cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "name": "network-vif-plugged", "status": "completed", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:29.081035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dc366f57-110b-4143-8038-43209ee42f9c req-4edcd0eb-6d73-4c9b-8630-a262749292cd service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.081608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dc366f57-110b-4143-8038-43209ee42f9c req-4edcd0eb-6d73-4c9b-8630-a262749292cd service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.096238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-dc366f57-110b-4143-8038-43209ee42f9c req-4edcd0eb-6d73-4c9b-8630-a262749292cd service nova] Creating event network-vif-plugged:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 09:33:29.101175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-dc366f57-110b-4143-8038-43209ee42f9c req-4edcd0eb-6d73-4c9b-8630-a262749292cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Aug 03 09:33:29.101760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 223/418] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:29.145778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:29.146513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:29.152638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.153134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.153900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.154338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.368004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:29.381396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f03b2f9-9fa7-42b9-9409-4c82eca8c7c6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.239644 Aug 03 09:33:29.382425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 196/419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:29.616949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:29.618140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:29.625444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.626146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.627122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.627747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.768065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:29.776650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f8373c03-ee6f-4ba5-a6cb-3e04aa3905bf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1714 microversion: 2.1 time: 0.164146 Aug 03 09:33:29.777249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 224/420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:29.969265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:29.971185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:29.980833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.981330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:29.982111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:29.982551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:30.205731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:30.215346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:30.217158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:30.218306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15bb64e3-d361-43ae-aca4-04c17ddc572d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1751 microversion: 2.20 time: 0.254571 Aug 03 09:33:30.218860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 197/421] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1751 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:30.404489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:30.405124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:30.412165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:30.412598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:30.413421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:30.413846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:30.565698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:30.574063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5708bcad-f916-4bc2-8941-99be5ac3368b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1371 microversion: 2.1 time: 0.174504 Aug 03 09:33:30.574959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 225/422] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:31.241838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:31.242521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:31.250171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.250998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.251954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.252598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.495433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:31.504057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:31.505920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:31.507226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-141f6d49-47e9-414a-ba84-119d9aacf23f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1753 microversion: 2.20 time: 0.269630 Aug 03 09:33:31.507770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 198/423] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1753 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:31.597406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:31.599247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:31.607302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.607757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.608956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.609077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.812361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:31.820397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a43f2039-393e-4b85-9fc7-7b11f321fa4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1564 microversion: 2.1 time: 0.229519 Aug 03 09:33:31.820991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 226/424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:31.842243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:31.842730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:31.848737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.849212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.849969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:31.850401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:31.930999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-44a25720-2662-4bb7-8fac-848840d0c66a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093277 Aug 03 09:33:31.931708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 199/425] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:33:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:33:32.530971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:32.531573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:32.538020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:32.538460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:32.539214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:32.539640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:32.793146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:32.807446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:32.810722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:32.814382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-46a078c2-2ac2-4518-b5fc-0dad8e3124f8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.287581 Aug 03 09:33:32.817164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 227/426] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:33:33.141336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-6d4513b4-8551-46cb-ab91-d09b7cd6093c req-a2cf5702-68c8-4f22-bfcf-b36b7512f5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:33.152588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6d4513b4-8551-46cb-ab91-d09b7cd6093c req-a2cf5702-68c8-4f22-bfcf-b36b7512f5c2 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:33.153374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6d4513b4-8551-46cb-ab91-d09b7cd6093c req-a2cf5702-68c8-4f22-bfcf-b36b7512f5c2 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:33.166052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-6d4513b4-8551-46cb-ab91-d09b7cd6093c req-a2cf5702-68c8-4f22-bfcf-b36b7512f5c2 service nova] Creating event network-changed:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 09:33:33.171642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-6d4513b4-8551-46cb-ab91-d09b7cd6093c req-a2cf5702-68c8-4f22-bfcf-b36b7512f5c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 Aug 03 09:33:33.172325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 200/427] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:33.841368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:33.842653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:33.851494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:33.852163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:33.853835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:33.854391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:34.018035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-328589462", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "networks": [{"uuid": "c6a40ddb-746a-4d57-bb3c-c9c8c448d9a2"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:34.080569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] validate_networks() for [('c6a40ddb-746a-4d57-bb3c-c9c8c448d9a2', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:33:34.132332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:34.142755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:34.145040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:34.146451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-092f3e2f-d0d7-4a23-bd56-59ca25aeb2ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.309062 Aug 03 09:33:34.147679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 228/428] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:34.592012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:33:34.593121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:33:34.593121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:33:34.593312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:33:34.593845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:33:34.608264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:34.611415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:34.612100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:34.612624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:34.632076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:34.667921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Getting quotas for project 7e4ee6e1000f4a87a92c3c34d1432cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:33:34.675165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Getting quotas for user 5bc1f887a65c4473bed69bed5dc8fe9f and project 7e4ee6e1000f4a87a92c3c34d1432cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:33:34.692469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:33:34.696078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:33:34.768469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fbe3f70b-786a-4413-96e7-60204a1f0ab8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755085 Aug 03 09:33:34.769646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 201/429] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 03 09:33:34.780998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e1cc18d8-f93f-463e-825c-ff1267486661 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:34.782286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e1cc18d8-f93f-463e-825c-ff1267486661 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:34.852628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e1cc18d8-f93f-463e-825c-ff1267486661 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:34.861815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e1cc18d8-f93f-463e-825c-ff1267486661 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1218 microversion: 2.1 time: 0.085143 Aug 03 09:33:34.862975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 229/430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:34 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:35.172753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:35.173738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:35.187227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:35.187725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:35.188805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:35.189231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:35.444683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:35.454162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:35.455653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:35.456799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b68a554-43ad-4e24-920e-27a2a7298964 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.289725 Aug 03 09:33:35.457371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 202/431] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:35.884179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:35.885381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:35.892722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:35.893193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:35.893950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:35.894383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:35.959416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:35.967846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5dab6a39-53e0-4ae1-b3c5-59b8294cc6e7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.087542 Aug 03 09:33:35.968690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 230/432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:35 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:36.481623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:36.482982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:36.490000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:36.490710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:36.491483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:36.491916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:36.627990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:36.637085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:36.638611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:36.639756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33bc298e-07f6-4ae0-aaea-3c46b94f047e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.162280 Aug 03 09:33:36.640305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 203/433] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:36.991022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:36.991795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:37.001140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:37.002085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:37.003169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:37.003717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:37.067298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:37.075247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5448becd-1a56-42d5-84d5-4b87c18e2bbf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.087841 Aug 03 09:33:37.075812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 231/434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:37.665278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:37.666952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:37.674847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:37.675374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:37.676211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:37.676852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:37.830299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:37.838947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:37.840462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:37.841707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a6e99416-f34c-46a8-a206-f120bd189909 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.181290 Aug 03 09:33:37.842274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 204/435] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:38.096990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:38.097524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:38.104945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:38.105387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:38.106150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:38.106576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:38.169466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:38.176836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab88b22e-cd97-4c7e-a2a5-a367bb30284e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.085128 Aug 03 09:33:38.177408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 232/436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:38.867429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:38.868044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:38.875941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:38.876477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:38.877270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:38.877707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:39.044846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:39.053337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:39.054852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:39.056553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-465bfc11-7787-4c20-afd1-613641d2cac9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.193397 Aug 03 09:33:39.057253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 205/437] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:39.198371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:39.198936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:39.202709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:39.206842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:39.207278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:39.208025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:39.208449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:39.277531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:39.279724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:39.290906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-612e7c81-fd14-48a6-9369-7da29fb2d6ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.097278 Aug 03 09:33:39.304433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 233/438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:40.079412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:40.080036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:40.086672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:40.087115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:40.088410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:40.088859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:40.225325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:40.233853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:40.235396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:40.236542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-702edc80-582b-4693-b7cd-abdcf87cee25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.161308 Aug 03 09:33:40.237129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 206/439] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:40.312528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:40.313997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:40.324672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:40.325706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:40.326706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:40.327418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:40.397868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:40.405573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ecb92a68-a112-4c9f-8d24-226a8ef3f81a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.097362 Aug 03 09:33:40.406340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 234/440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:41.260389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:41.261315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:41.267870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:41.268381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:41.269178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:41.269842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:41.418776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:41.427189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:41.427803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:41.435398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:41.435849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:41.436621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:41.436727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:41.438274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:41.438766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:41.439440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62ab3f27-5603-42f2-9139-ed4deb424d67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.183672 Aug 03 09:33:41.449054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 207/441] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:41.503526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:41.511382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-420cf530-e152-4f17-9181-8dfbc8363f09 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.088008 Aug 03 09:33:41.511870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 235/442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:42.464806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:42.465421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:42.471978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:42.472419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:42.473430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:42.473857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:42.532452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:42.533187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:42.541753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:42.542525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:42.543522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:42.544025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:42.614091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:42.620506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:42.625207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9bbfaf8-08ad-4898-a1b4-ebed484729de tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.096563 Aug 03 09:33:42.632877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 236/443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:42 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:33:42.633049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:42.633049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:42.633226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aa9acee2-afea-4a38-8878-1398caa2d30c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.172646 Aug 03 09:33:42.633831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 208/444] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:43.652960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:43.654606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:43.662776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:43.663518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:43.663692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:43.664383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:43.664882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:43.665024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:43.672836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:43.673294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:43.674067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:43.674679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:43.747966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:43.755800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c36260c-3e60-453c-8858-6f8daf72a65e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.107704 Aug 03 09:33:43.756974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 237/445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:43.842016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:43.850997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:43.852677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:43.854029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b38ae920-ec30-4397-b66f-7eb07f042abf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.194221 Aug 03 09:33:43.854629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 209/446] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:44.778935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:44.780674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:44.789381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:44.790040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:44.791796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:44.792637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:44.861900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:44.876292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:44.876852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:44.879676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:44.883917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:44.884691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:44.889644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d5d3e246-abb6-46f3-92f3-c4d002061d7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1222 microversion: 2.1 time: 0.116114 Aug 03 09:33:44.890129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:44.890353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 238/447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:44.890582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:44.891360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:44.891800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:45.045290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:45.055978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:45.058154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:45.059326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c3956a7-fd27-4cef-8894-ff18dcf9e173 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.186955 Aug 03 09:33:45.059876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 210/448] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:45.914756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:45.915423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:45.922742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:45.923188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:45.923956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:45.924391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:45.989078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:45.997105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c5a48cd7-0567-4fa0-bf37-ff653e233355 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1214 microversion: 2.1 time: 0.089482 Aug 03 09:33:45.997662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 239/449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:46.082119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:46.082786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:46.090195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:46.090650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:46.091417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:46.091851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:46.230524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:46.239043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:46.240556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:46.241950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6630c928-387e-4de1-b32c-6194f660d913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.163826 Aug 03 09:33:46.242541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 211/450] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:47.017901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:47.018632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:47.024970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:47.025989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:47.026751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:47.027174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:47.095399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:47.103300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4ae9a9e-26e2-4062-9de3-fcd42c546402 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1278 microversion: 2.1 time: 0.089283 Aug 03 09:33:47.103876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 240/451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:47.247780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:33:47.248783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:33:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:33:47.266076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:47.266681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:47.293087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:47.293654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:47.294634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:47.295073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:47.514388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:47.523101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:47.524603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:47.525896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bde239f6-43d6-457a-9605-22819c6cf271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.263644 Aug 03 09:33:47.533745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 212/452] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:48.124605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:48.125231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:48.132382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:48.132939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:48.133702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:48.134155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:48.270617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:48.279187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2d863356-0ab6-41bf-95db-e53b361432c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.158409 Aug 03 09:33:48.280327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 241/453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:48 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:48.388791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-c4e6808b-2c41-4e40-a175-74335d000bba req-8de20337-394e-47f7-bd59-b4d7fd4672b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b12ac06-e52e-4590-b8ab-1007b884d39a", "tag": "1113323c-2181-4574-a9f7-316ac94d7b4b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:48.402667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c4e6808b-2c41-4e40-a175-74335d000bba req-8de20337-394e-47f7-bd59-b4d7fd4672b4 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:48.403126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c4e6808b-2c41-4e40-a175-74335d000bba req-8de20337-394e-47f7-bd59-b4d7fd4672b4 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:48.415517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-c4e6808b-2c41-4e40-a175-74335d000bba req-8de20337-394e-47f7-bd59-b4d7fd4672b4 service nova] Creating event network-changed:1113323c-2181-4574-a9f7-316ac94d7b4b for instance 9b12ac06-e52e-4590-b8ab-1007b884d39a on hv-cinder-84456 Aug 03 09:33:48.420555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-c4e6808b-2c41-4e40-a175-74335d000bba req-8de20337-394e-47f7-bd59-b4d7fd4672b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036261 Aug 03 09:33:48.421557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 213/454] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:48.549378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:48.550291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:48.557952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:48.559032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:48.559566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:48.560275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:48.700549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:48.709252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:48.710755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:48.711904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a23605f-6b71-4f10-ba55-4109f2dcd5eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.166602 Aug 03 09:33:48.712457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 242/455] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:49.300284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:49.301029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:49.307164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:49.307546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:49.308292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:49.308786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:49.439917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:49.447228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ec229c24-2813-45cd-823c-cddbc4534a4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.151096 Aug 03 09:33:49.447785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 214/456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:49 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:49.735434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:49.736036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:49.742666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:49.743110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:49.743863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:49.744295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:49.875976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:49.884285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:49.886345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:49.887807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-54e933d2-822b-4c27-81b6-61be7cb7ab81 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.156296 Aug 03 09:33:49.888359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 243/457] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:50.467634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:50.468240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:50.472012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:50.475748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:50.476200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:50.477001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:50.477487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:50.681758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:50.689797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df975877-b725-47f0-ae6f-0b5559fea3fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.226168 Aug 03 09:33:50.690370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 215/458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:50.911252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:50.911789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:50.918593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:50.919032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:50.919783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:50.920208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:51.046899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:51.055402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:51.057098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:51.059197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-24a69bb8-a57c-436b-afa3-947a377db583 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.151929 Aug 03 09:33:51.059753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 244/459] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:51.711007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:51.711606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:51.719784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:51.720225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:51.720996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:51.721431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:51.849916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:51.858145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2420ae3-e596-40c7-9923-acc6fe2262e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.150985 Aug 03 09:33:51.858699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 216/460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:52.083071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:52.083730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:52.090948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:52.091395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:52.092153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:52.092590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:52.222133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:52.230599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:52.232280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:52.233454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-83c26596-9bfc-43e5-9721-6251f2b8ccf2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.154328 Aug 03 09:33:52.234012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 245/461] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:52.878738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:52.879341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:52.885829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:52.886437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:52.887309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:52.887743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:53.020051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:53.028179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e5c0416-ceb1-4f1a-9000-dec9651606e4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.153301 Aug 03 09:33:53.028798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 217/462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:53.256944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:53.257475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:53.264239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:53.264685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:53.265489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:53.265921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:53.397125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:53.406334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:53.407827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:53.408998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a51c201-5ae3-4a1e-a64c-c5b87978fa6c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.156100 Aug 03 09:33:53.409557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 246/463] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:54.048437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:54.049071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:54.055718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:54.056464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:54.056935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:54.057366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:54.186753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:54.194277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-894d404c-b329-4196-8866-94bfcc0cc251 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.149666 Aug 03 09:33:54.194846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 218/464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:54 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:54.431339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:54.431938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:54.439598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:54.440044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:54.440796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:54.441253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:54.570116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:54.578913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:54.580410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:54.581603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8462e5ed-8637-4bb8-a2d6-734587be9c7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.154165 Aug 03 09:33:54.582159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 247/465] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:54.897019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-9f78f2eb-709e-4a6d-8381-997ff4390191 req-08f32186-b317-4d5b-b06a-5dbc81cc7ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b12ac06-e52e-4590-b8ab-1007b884d39a", "name": "network-vif-plugged", "status": "completed", "tag": "1113323c-2181-4574-a9f7-316ac94d7b4b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:33:54.907947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9f78f2eb-709e-4a6d-8381-997ff4390191 req-08f32186-b317-4d5b-b06a-5dbc81cc7ada service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:54.908494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9f78f2eb-709e-4a6d-8381-997ff4390191 req-08f32186-b317-4d5b-b06a-5dbc81cc7ada service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:54.913581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:54.922566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-9f78f2eb-709e-4a6d-8381-997ff4390191 req-08f32186-b317-4d5b-b06a-5dbc81cc7ada service nova] Creating event network-vif-plugged:1113323c-2181-4574-a9f7-316ac94d7b4b for instance 9b12ac06-e52e-4590-b8ab-1007b884d39a on hv-cinder-84456 Aug 03 09:33:54.927434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-9f78f2eb-709e-4a6d-8381-997ff4390191 req-08f32186-b317-4d5b-b06a-5dbc81cc7ada service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034286 Aug 03 09:33:54.928018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 219/466] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:33:55.215922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:55.216558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:55.222707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:55.223298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:55.223933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:55.224343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:55.367408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:55.374952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b6a312ea-d97e-4150-947a-1f734dbf6430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.163612 Aug 03 09:33:55.375516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 248/467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:55 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:55.606008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:55.606698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:55.613413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:55.613912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:55.614666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:55.615096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:55.747318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:55.755874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:55.757402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:55.758544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ac3276b-35c8-4d88-88ae-e8214c4a9b5c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.157637 Aug 03 09:33:55.759105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 220/468] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:56.395557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:56.396156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:56.402636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:56.403083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:56.403853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:56.404277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:56.540803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:56.549013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7de8d48-d6e9-4290-bdf4-9211dbcc6c69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.157364 Aug 03 09:33:56.549574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 249/469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:56.782242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:56.782787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:56.789238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:56.789680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:56.790425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:56.790850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:56.921429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:56.929664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:56.931166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:56.932303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3b74286-6f94-493c-a6e6-3cfe3dca41dc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.154606 Aug 03 09:33:56.932880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 221/470] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:57.569830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:57.570432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:57.578017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:57.578456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:57.579200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:57.579627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:57.594253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:33:57.714086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:57.724168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08957417-615b-47ba-9924-926178ce502e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.158092 Aug 03 09:33:57.724746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 250/471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:57.955589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:57.956190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:57.962657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:57.963098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:57.963843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:57.964272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:58.096062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:58.104380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:58.106534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:58.107847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc9e8d62-9bdd-4be0-bb45-be3ef4e77d75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.156162 Aug 03 09:33:58.108401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 222/472] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:58.746253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:58.747407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:58.753636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:58.754073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:58.754838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:58.755255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:58.887929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:58.895464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-571ca1c7-34e4-4b77-91d7-ae1ca71e0daa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1318 microversion: 2.1 time: 0.154260 Aug 03 09:33:58.896024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 251/473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:33:59.131362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:59.131967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:59.138502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:59.138941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:59.139687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:59.140116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:59.269197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:59.277483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:59.279674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:33:59.280841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00a41923-77cd-4a76-b186-794af9a83a44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.153392 Aug 03 09:33:59.281388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 223/474] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:33:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:33:59.916057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:33:59.916835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:33:59.923352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:59.923869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:33:59.924763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:33:59.925283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:00.058847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:00.067217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-99d2763e-ba52-4cb9-b857-8f0aa55e0398 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1506 microversion: 2.1 time: 0.155287 Aug 03 09:34:00.067986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 252/475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:33:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:00.304878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:00.305489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:00.312609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:00.313083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:00.313850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:00.314284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:00.468188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:00.477281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:00.479008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:00.480287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-05cb8817-6107-4790-9821-370c5e3a7df8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.179352 Aug 03 09:34:00.481841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 224/476] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:34:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:34:00.942336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-8b596cf9-2472-49be-b6ed-7aa09137afc7 req-33c0b737-2337-427b-950c-0b2d8c51276a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "name": "network-vif-plugged", "status": "completed", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:00.953096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8b596cf9-2472-49be-b6ed-7aa09137afc7 req-33c0b737-2337-427b-950c-0b2d8c51276a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:00.953544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-8b596cf9-2472-49be-b6ed-7aa09137afc7 req-33c0b737-2337-427b-950c-0b2d8c51276a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:00.965759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-8b596cf9-2472-49be-b6ed-7aa09137afc7 req-33c0b737-2337-427b-950c-0b2d8c51276a service nova] Creating event network-vif-plugged:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:34:00.970841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-8b596cf9-2472-49be-b6ed-7aa09137afc7 req-33c0b737-2337-427b-950c-0b2d8c51276a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 Aug 03 09:34:00.971444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 253/477] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:01.504644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:01.505481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:01.513555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:01.514055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:01.514957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:01.515411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:01.660242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:01.669737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:01.671866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:01.673313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3697db23-3b50-48cd-a8f2-88bb8008bfb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.173568 Aug 03 09:34:01.674225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 225/478] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:34:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:34:02.698118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:02.698841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:02.705388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:02.705835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:02.706599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:02.707033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:02.843257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:02.851609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:02.853143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:02.854307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-602b40bf-637f-4446-945b-e710e27fabd0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.161085 Aug 03 09:34:02.854873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 254/479] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:34:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:34:03.878518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:03.879209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:03.885933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:03.886373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:03.887124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:03.887550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:04.026441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:04.035598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:04.037233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:04.038541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc4dc653-49c3-4676-88f8-af5751034ab1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1809 microversion: 2.20 time: 0.164279 Aug 03 09:34:04.040111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 226/480] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:34:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:34:05.065249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:05.065999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:05.073503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:05.074120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:05.074905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:05.075337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:05.206936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:05.215754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:05.217346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:05.218526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ef24e9d8-1136-4b6c-b646-aae66f2a67d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1796 microversion: 2.20 time: 0.157351 Aug 03 09:34:05.219080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 255/481] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:34:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1796 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:34:10.904555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:10.905712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:10.912413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:10.912797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:10.913574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:10.913999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:10.937107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd6ae299-091a-4365-9e3c-9608b3751a15 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/ips" status: 200 len: 150 microversion: 2.1 time: 0.036376 Aug 03 09:34:10.937659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 227/482] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:34:10 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:10.949926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60828bc0-ab0a-464a-9867-49f7fc877608"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:10.953457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:10.956009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=45 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:10.961299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:10.961745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:10.962503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:10.962961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:11.043359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/os-volume_attachments HTTP/1.1 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 74 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:34:11.045210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {"volumeAttachment": {"volumeId": "60828bc0-ab0a-464a-9867-49f7fc877608"}} Aug 03 09:34:11.047338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '31118185-b7f0-486e-a7d9-6d518fb07d3c', 'body': {'volumeAttachment': {'volumeId': '60828bc0-ab0a-464a-9867-49f7fc877608'}}} Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:34:11.048257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:11.052303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 400 to user: Invalid volume: volume 60828bc0-ab0a-464a-9867-49f7fc877608 is already attached to instances: c3dcc900-18b4-4f36-911d-e61fc4a9cc58 {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a327aaa1-8233-4b67-b35d-1930b83cf14a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101356 Aug 03 09:34:11.053553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 256/483] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:34:10 2022] POST /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:34:11.059790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:11.060290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:11.066702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:11.067137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:11.067887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:11.068314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:11.095852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:34:11.175338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71fd1f9b-9cd3-4cbf-bfb3-caca19d34186 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 204 len: 0 microversion: 2.1 time: 0.119604 Aug 03 09:34:11.175933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 228/484] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:34:11 2022] DELETE /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:34:11.184025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:11.184633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:11.191742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:11.192259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:11.193169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:11.193719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:11.336167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:11.343108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cae96d82-89da-47ec-9521-c8129e78202c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1682 microversion: 2.1 time: 0.162277 Aug 03 09:34:11.343679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 257/485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:11 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:34:12.365064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:12.365777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:12.373093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:12.373597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:12.375054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:12.375636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:12.511247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:12.518810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-374bf4f0-76f7-4e0c-b7f3-023494862d4c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1682 microversion: 2.1 time: 0.158223 Aug 03 09:34:12.519381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 229/486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:12 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:13.540975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:13.541986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:13.550770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:13.551209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:13.551991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:13.552418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:13.689107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:13.696894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ed0fdbd5-ec2a-4ce1-89cf-ae511b8b50e5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1682 microversion: 2.1 time: 0.160121 Aug 03 09:34:13.697480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 258/487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:13 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:14.316520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-fad178d2-00df-4b00-8d57-8b67418be153 req-a7a38975-e062-460e-84de-81cc1f99883a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31118185-b7f0-486e-a7d9-6d518fb07d3c", "name": "network-vif-deleted", "tag": "271e1ecd-8ee9-4bf4-b59f-05c05fb81716"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:14.328047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-fad178d2-00df-4b00-8d57-8b67418be153 req-a7a38975-e062-460e-84de-81cc1f99883a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:14.328637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-fad178d2-00df-4b00-8d57-8b67418be153 req-a7a38975-e062-460e-84de-81cc1f99883a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:14.355732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-fad178d2-00df-4b00-8d57-8b67418be153 req-a7a38975-e062-460e-84de-81cc1f99883a service nova] Creating event network-vif-deleted:271e1ecd-8ee9-4bf4-b59f-05c05fb81716 for instance 31118185-b7f0-486e-a7d9-6d518fb07d3c on hv-cinder-84456 Aug 03 09:34:14.364387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-fad178d2-00df-4b00-8d57-8b67418be153 req-a7a38975-e062-460e-84de-81cc1f99883a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052521 Aug 03 09:34:14.365034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 230/488] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:14.721215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:14.721832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:14.729910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:14.730363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:14.731140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:14.731575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:14.763307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:14.763708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:14.764159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lazy-loading 'fault' on Instance uuid 31118185-b7f0-486e-a7d9-6d518fb07d3c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:34:14.827320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:14.835666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-27105edf-50af-4248-b134-64d9aa5ebce2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 200 len: 1331 microversion: 2.1 time: 0.118709 Aug 03 09:34:14.836739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 259/489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:14 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:15.861225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:15.861928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:15.868159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:15.868609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:15.869392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:15.869827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:15.883532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c HTTP/1.1 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:34:15.885138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:34:15.886688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '31118185-b7f0-486e-a7d9-6d518fb07d3c'} Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:34:15.887495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:34:15.888737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:15.889866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:34:15.889866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d31b7d81-cefa-4b64-a715-b69682f1fff0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 404 len: 111 microversion: 2.1 time: 0.030605 Aug 03 09:34:15.889866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 231/490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:15 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:34:15.895421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8e12a48a-0f7e-4fea-b44a-e6d75fa096e2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '.version_select at 0x7fb998c3d700>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:15.918066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8e12a48a-0f7e-4fea-b44a-e6d75fa096e2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653932289" status: 202 len: 0 microversion: 2.1 time: 0.026487 Aug 03 09:34:15.918634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 260/491] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 3 09:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653932289 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:34:16.587119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:16.587607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:16.594360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:16.594794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:16.595538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:16.595965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:16.723161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lazy-loading 'services' on Instance uuid c3dcc900-18b4-4f36-911d-e61fc4a9cc58 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:34:16.836860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fef05e58-7316-4df5-bfe4-c4331223224e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments/60828bc0-ab0a-464a-9867-49f7fc877608" status: 202 len: 0 microversion: 2.1 time: 0.253442 Aug 03 09:34:16.837520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 232/492] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:34:16 2022] DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments/60828bc0-ab0a-464a-9867-49f7fc877608 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:34:16.846715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:16.848976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:16.855685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:16.856066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:16.856774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:16.857231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:16.890777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2559a4a5-52c3-4234-a19b-fd05a3e1cea3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048744 Aug 03 09:34:16.891327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 261/493] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:34:16 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:17.904577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:17.907855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:17.914772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:17.915228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:17.915996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:17.916425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:17.947592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c512d47c-89fa-48dd-a2d6-4851c66123fb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048041 Aug 03 09:34:17.948303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 233/494] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:34:17 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:18.960390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:18.962453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:18.969464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:18.969914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:18.970671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:18.971101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.000805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0891d49e-6147-4a6c-80bb-709d3a8d38f0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044536 Aug 03 09:34:19.001376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 262/495] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:34:18 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 09:34:19.063684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:19.064197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:19.070527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.070968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.071714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.072138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.097127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:34:19.129349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:19.169644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2ec38a8-47c8-48fe-84f7-e763989ef1f1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 204 len: 0 microversion: 2.1 time: 0.110444 Aug 03 09:34:19.170401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 234/496] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:34:19 2022] DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:34:19.179141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:19.179735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:19.185821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.186298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.187273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.187713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.325403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:19.333461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6475c4f4-6e8b-44ab-a33f-e4a9c6b9bbdb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1683 microversion: 2.1 time: 0.158299 Aug 03 09:34:19.334026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 263/497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:19 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:34:19.506803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a566152-3024-463a-a81b-2b874950c0a4", "device": "/dev/sdb"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:19.509735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:19.515962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.516409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:19.517196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:19.517632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:20.355439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:20.356038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:20.363767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:20.364210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:20.365003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:20.365479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:20.495106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:20.503383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38f5433b-003c-4639-9293-6110153cd401 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1683 microversion: 2.1 time: 0.151808 Aug 03 09:34:20.503949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 264/498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:20 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:34:21.091914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cc2c9119-5cf7-4f17-aba5-60ed9be12854 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "POST /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.589180 Aug 03 09:34:21.093405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 235/499] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:34:19 2022] POST /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments => generated 194 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:21.525515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:21.526071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:21.533114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:21.533557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:21.534345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:21.534773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:21.666503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:21.675378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-05896190-9563-4ef8-848f-c04650287470 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1683 microversion: 2.1 time: 0.153779 Aug 03 09:34:21.675951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 265/500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:21 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:22.149187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-65a35f06-95bb-4978-9942-39bb958e934f req-27b382ed-e0a8-46dc-8840-fd691c8ddc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dcc900-18b4-4f36-911d-e61fc4a9cc58", "name": "network-vif-deleted", "tag": "a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:22.154515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:22.161988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65a35f06-95bb-4978-9942-39bb958e934f req-27b382ed-e0a8-46dc-8840-fd691c8ddc7e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:22.162212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-65a35f06-95bb-4978-9942-39bb958e934f req-27b382ed-e0a8-46dc-8840-fd691c8ddc7e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:22.174844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-65a35f06-95bb-4978-9942-39bb958e934f req-27b382ed-e0a8-46dc-8840-fd691c8ddc7e service nova] Creating event network-vif-deleted:a9835cd0-aeee-4d2f-a2c5-ce9aeea7bd3f for instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 on hv-cinder-84456 Aug 03 09:34:22.179562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-65a35f06-95bb-4978-9942-39bb958e934f req-27b382ed-e0a8-46dc-8840-fd691c8ddc7e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034359 Aug 03 09:34:22.180534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 236/501] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:22.697878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:22.698508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:22.705763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:22.706210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:22.706970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:22.707602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:22.743345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:22.744103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:22.744755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lazy-loading 'fault' on Instance uuid c3dcc900-18b4-4f36-911d-e61fc4a9cc58 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:34:22.787645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:22.794583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab0352a9-277e-42f4-a636-f1d0ac9fd263 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 200 len: 1332 microversion: 2.1 time: 0.100936 Aug 03 09:34:22.795161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 266/502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:22 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:23.818763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:23.819999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:23.827551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:23.827945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:23.828708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:23.829164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:23.845556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 HTTP/1.1 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:34:23.848681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:34:23.850220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'c3dcc900-18b4-4f36-911d-e61fc4a9cc58'} Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:34:23.851278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:34:23.852804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:34:23.854196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:34:23.854196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f184700-ad4b-4692-8df2-1ba9d409a2b8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 404 len: 111 microversion: 2.1 time: 0.036558 Aug 03 09:34:23.854196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 237/503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:23 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:34:23.860923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50d8c129-f6ff-4232-a9db-0cf8716bb08c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '.version_select at 0x7fb998d04310>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:23.882138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50d8c129-f6ff-4232-a9db-0cf8716bb08c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264816701" status: 202 len: 0 microversion: 2.1 time: 0.026139 Aug 03 09:34:23.882724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 267/504] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 3 09:34:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264816701 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:34:24.537115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f92d53ca-cf3e-442d-80dd-ca466361d1d8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: .version_select at 0x7fb998ce3b80>, body: {"keypair": {"name": "tempest-keypair-1065862670", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGp5yalMcoc79vc137pJlLeD7xR+Gz0a0YCBfKFlpT7UL8xdnHbqxRjqicnzzrkzDvjh97I4fFKT/JYiRSjVXwVHaDgtr2q314V4L4hIKRC6Gh3ZQUsNvOpoCnB/7MqlQ=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:24.554540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-f92d53ca-cf3e-442d-80dd-ca466361d1d8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:34:24.559090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-f92d53ca-cf3e-442d-80dd-ca466361d1d8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:34:24.583394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f92d53ca-cf3e-442d-80dd-ca466361d1d8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050011 Aug 03 09:34:24.584209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 238/505] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:34:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:26.142077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-184888112", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b08b9e0-74e3-4321-8eca-779df9e19114"}], "security_groups": [{"name": "tempest-securitygroup--1444899837"}], "key_name": "tempest-keypair-1065862670", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:26.247375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] validate_networks() for [('1b08b9e0-74e3-4321-8eca-779df9e19114', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:34:26.862045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:34:26.862464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:34:26.862929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:34:26.863331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:34:26.863787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:34:26.872732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:26.873201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:26.873994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:26.874535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:26.892275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:34:26.896092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:34:26.907617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:34:26.909938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:34:26.958759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f88dcfaf-c06c-48d5-bcb7-823add2bdabd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.821696 Aug 03 09:34:26.959449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 268/506] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:34:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:34:26.971506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f5ecd44-1d48-442d-af1b-b71251c361fa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:26.972124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f5ecd44-1d48-442d-af1b-b71251c361fa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:27.036051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f5ecd44-1d48-442d-af1b-b71251c361fa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:27.042587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f5ecd44-1d48-442d-af1b-b71251c361fa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1241 microversion: 2.1 time: 0.076086 Aug 03 09:34:27.043137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 239/507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:26 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:28.064170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:28.064788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:28.071404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.071847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:28.072660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.073069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:28.076951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=96 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:28.139294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:28.146737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-41a94f9c-a832-4b74-9510-0eb377904eff tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1293 microversion: 2.1 time: 0.087090 Aug 03 09:34:28.147293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 269/508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:28 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:28.689781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81d0c922-cbca-483f-ad58-bde813a31cba"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:28.692130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:28.699292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.699744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:28.700722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.701573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:28.964391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:28.965502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:28.971659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.972103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:28.972884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:28.973918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:29.010111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aec34962-04d1-472c-b063-f37ee620fda0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324932 Aug 03 09:34:29.010716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 240/509] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 09:34:28 2022] POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:29.149415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lazy-loading 'services' on Instance uuid 92a1a022-8f7e-4e28-9a07-49184dfcfcfd {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:34:29.169541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:29.170619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:29.180743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:29.182155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:29.183209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:29.187313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:29.273564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:29.282471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-acd3110f-8a26-4089-a008-64829d6abc47 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1299 microversion: 2.1 time: 0.117319 Aug 03 09:34:29.283174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 241/510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:29 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:29.284494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e1f35a05-dcae-4096-88fd-401f3a22c401 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments/974679dc-5d02-4c05-8bb5-f00ba6fd5522" status: 202 len: 0 microversion: 2.1 time: 0.323900 Aug 03 09:34:29.285168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 270/511] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:34:28 2022] DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments/974679dc-5d02-4c05-8bb5-f00ba6fd5522 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 09:34:30.304089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:30.304689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:30.311241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:30.311623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:30.312369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:30.312796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:30.447691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:30.456285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8522f6e0-f8d9-4add-b042-1117b52771a2 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.156058 Aug 03 09:34:30.456862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 242/512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:30 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:31.478395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:31.479100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:31.486547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:31.486995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:31.487766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:31.488204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:31.619664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:31.627851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9a7b14e-a17e-477c-a3f7-320294242629 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.153868 Aug 03 09:34:31.628420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 271/513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:31 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:32.548358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-dfab0c56-430a-403b-83cb-f2708e0fbd93 req-5df3b461-83d8-44fa-a4a9-adbe3bb2ca0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9481377c-68db-499c-a657-afe14aabd667", "tag": "e9477d30-2366-4eaf-851e-05f42903a14b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:32.564079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-dfab0c56-430a-403b-83cb-f2708e0fbd93 req-5df3b461-83d8-44fa-a4a9-adbe3bb2ca0a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:32.564546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-dfab0c56-430a-403b-83cb-f2708e0fbd93 req-5df3b461-83d8-44fa-a4a9-adbe3bb2ca0a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:32.580526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-dfab0c56-430a-403b-83cb-f2708e0fbd93 req-5df3b461-83d8-44fa-a4a9-adbe3bb2ca0a service nova] Creating event network-changed:e9477d30-2366-4eaf-851e-05f42903a14b for instance 9481377c-68db-499c-a657-afe14aabd667 on hv-cinder-84456 Aug 03 09:34:32.588203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-dfab0c56-430a-403b-83cb-f2708e0fbd93 req-5df3b461-83d8-44fa-a4a9-adbe3bb2ca0a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044680 Aug 03 09:34:32.588989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 243/514] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:34:32.650680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:32.651452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:32.659037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:32.659489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:32.660338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:32.660680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:32.793085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:32.800757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ec53ba68-18fc-4800-b488-e43b133ccf13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.154110 Aug 03 09:34:32.801398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 272/515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:32 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:33.822796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:33.823406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:33.831752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:33.832416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:33.833514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:33.834152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:33.970673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:33.978195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aeff6b6d-9830-478e-8d68-c133e368e374 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.159638 Aug 03 09:34:33.978760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 244/516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:33 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:35.000143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:35.000674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:35.007243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:35.007682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:35.008431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:35.008884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:35.146319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:35.153867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b4d99dd9-ba43-484b-93c0-ce104eef1592 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.158257 Aug 03 09:34:35.154453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 273/517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:34 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:36.175353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:36.175955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:36.182473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:36.182896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:36.183647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:36.184072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:36.314801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:36.322257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67ff6150-3d60-4ab8-bb2f-d82103feaccf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.151097 Aug 03 09:34:36.322818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 245/518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:36 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:37.343920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:37.344754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:37.348178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:37.348952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:37.356370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:37.357061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:37.358005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:37.358480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:37.518611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:37.526304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-49f72827-dd5f-4ba3-b3a8-06f884bda1cc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.186646 Aug 03 09:34:37.537500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 274/519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:37 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:38.547735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:38.548341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:38.550298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:38.555941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:38.556383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:38.557165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:38.557598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:38.706207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:38.714447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b52e6e00-45d5-49e7-8762-41af263cc2a6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.170863 Aug 03 09:34:38.715035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 246/520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:38 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:39.735777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:39.736371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:39.742843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:39.743283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:39.744025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:39.744449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:39.880276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:39.887770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93fc780e-282f-4ee2-b3d4-93f2bb8955c6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.155837 Aug 03 09:34:39.888305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 275/521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:39 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:40.909559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:40.910167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:40.916665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:40.917169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:40.917919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:40.918352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:41.045554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:41.053210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2004762b-1611-47f6-8f40-8c0c4dd41870 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.148233 Aug 03 09:34:41.053782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 247/522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:40 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:42.074742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:42.075530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:42.079041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:42.084383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:42.085126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:42.085965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:42.086470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:42.090744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-b1c44aa9-f330-4f10-83f8-ca6db21bedd5 req-858cb62b-4122-4768-818f-a4c7b6daa581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9481377c-68db-499c-a657-afe14aabd667", "name": "network-vif-plugged", "status": "completed", "tag": "e9477d30-2366-4eaf-851e-05f42903a14b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:34:42.102380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b1c44aa9-f330-4f10-83f8-ca6db21bedd5 req-858cb62b-4122-4768-818f-a4c7b6daa581 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:42.102839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b1c44aa9-f330-4f10-83f8-ca6db21bedd5 req-858cb62b-4122-4768-818f-a4c7b6daa581 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:42.115022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-b1c44aa9-f330-4f10-83f8-ca6db21bedd5 req-858cb62b-4122-4768-818f-a4c7b6daa581 service nova] Creating event network-vif-plugged:e9477d30-2366-4eaf-851e-05f42903a14b for instance 9481377c-68db-499c-a657-afe14aabd667 on hv-cinder-84456 Aug 03 09:34:42.119813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-b1c44aa9-f330-4f10-83f8-ca6db21bedd5 req-858cb62b-4122-4768-818f-a4c7b6daa581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033626 Aug 03 09:34:42.120612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 248/523] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:34:42.222378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:42.229923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9a58ea0-de7f-4aa2-8e93-4ec289e81543 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.159141 Aug 03 09:34:42.230805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 276/524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:42 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:43.252256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:43.252933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:43.259302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:43.259743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:43.260509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:43.260963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:43.389399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:43.397079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7becf445-a22e-4b20-b1d6-8f5a43be6dcf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149930 Aug 03 09:34:43.397636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 249/525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:43 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:44.418888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:44.419489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:44.426536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:44.427073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:44.427868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:44.428340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:44.556111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:44.564123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d306b096-6499-4d1a-b3de-a70eaebc56d3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149071 Aug 03 09:34:44.564686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 277/526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:44 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:45.584990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:45.585623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:45.592056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:45.592490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:45.593285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:45.593711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:45.727992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:45.735493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-907d7b9c-e104-494c-bcfa-c7782858ba6b tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.154365 Aug 03 09:34:45.736056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 250/527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:45 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:34:46.755787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:46.756398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:46.763007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:46.763454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:46.764222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:46.764656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:46.901833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:46.910119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6158c6ab-1e46-4bb3-ab55-8d94996bebfa tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.158121 Aug 03 09:34:46.910688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 278/528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:46 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:47.931452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:47.931993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:47.939467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:47.939914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:47.940676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:47.941143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:48.071842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:48.079544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87626070-b56d-4de8-8588-7d022e3368eb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.152035 Aug 03 09:34:48.080110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 251/529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:47 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:49.100605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:49.101256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:49.107829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:49.108279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:49.109096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:49.109533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:49.237559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:49.244892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-83354792-4cb7-40f0-b400-d57a4a926159 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.148479 Aug 03 09:34:49.245448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 279/530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:49 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:50.268077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:50.268677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:50.275563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:50.276010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:50.276764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:50.277226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:50.282056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:50.414477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:50.421956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-50134be7-358f-4ed9-994c-8bd5d2d5e947 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.157712 Aug 03 09:34:50.422519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 252/531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:50 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:51.443072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:51.443684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:51.450140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:51.450586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:51.451374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:51.451800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:51.589605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:51.598249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a63d4cca-5699-4d1a-9750-187b4821c7dd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.158993 Aug 03 09:34:51.598804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 280/532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:51 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:52.620236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:52.620870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:52.623200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:52.629597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:52.630107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:52.630918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:52.631359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:52.760023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:52.767441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea858845-e819-4957-b2cb-fbf37451a87f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.151319 Aug 03 09:34:52.768002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 253/533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:52 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:53.788023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:53.788539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:53.794669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:53.795111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:53.795861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:53.796828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:53.927903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:53.935260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1ef7dd6f-80d9-4a58-8b72-db67f1ed0b13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.151119 Aug 03 09:34:53.935842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 281/534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:53 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:54.957785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:54.958477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:54.965216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:54.965660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:54.966419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:54.966844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:55.096270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:55.103699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4de9d6b-fd41-4900-9c7c-5ca9f68f6f4d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.150450 Aug 03 09:34:55.104269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 254/535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:54 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:56.048983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:56.049528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:56.056133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.056586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.057377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.057813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.087209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8cf928a-510d-44cd-8b39-793f068412f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments/2918f67e-0782-49e1-889d-1b8184699478" status: 200 len: 194 microversion: 2.20 time: 0.042675 Aug 03 09:34:56.087795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 282/536] 10.222.0.20 () {60 vars in 1454 bytes} [Wed Aug 3 09:34:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments/2918f67e-0782-49e1-889d-1b8184699478 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:34:56.125502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:56.126258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:56.132702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.133240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.133999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.134421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.155535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:56.156183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:56.162286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.162733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.163498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.163942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.246652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lazy-loading 'services' on Instance uuid c30c986d-ad83-45a8-b4e6-96d056aaa6d5 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:34:56.269994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:56.277520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c12f9303-8293-4f2d-a0e2-ba40b6aea4b1 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.156474 Aug 03 09:34:56.278089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 255/537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:56 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:56.318686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-91e0d06c-685f-4503-aabf-4ba843716438 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments/2918f67e-0782-49e1-889d-1b8184699478" status: 202 len: 0 microversion: 2.20 time: 0.166855 Aug 03 09:34:56.319269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 283/538] 10.222.0.20 () {60 vars in 1457 bytes} [Wed Aug 3 09:34:56 2022] DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments/2918f67e-0782-49e1-889d-1b8184699478 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 03 09:34:56.327800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:56.330178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:56.336252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.336745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.337512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:56.337937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:56.367556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83992022-acd8-4115-9177-f12a0d628c49 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043877 Aug 03 09:34:56.368096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 256/539] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:34:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:34:57.300933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:57.301539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:57.307679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:57.308115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:57.308886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:57.309315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:57.324800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:34:57.380330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:57.382459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:57.388917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:57.389368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:57.391118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:57.391221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:57.423254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-43f16299-0789-4e23-8f61-48f16b92e94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046857 Aug 03 09:34:57.423818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 257/540] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:34:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:34:57.446717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:57.454817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bd9b77b9-e606-4c5d-8a06-0c16e6bcb2ed tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.159796 Aug 03 09:34:57.455371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 284/541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:57 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:34:58.435697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:58.438753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:58.445456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:58.445901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:58.446655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:58.447086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:58.475324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:58.475924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:58.476136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4117f93-7307-46a3-aee0-33d13f8519eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Aug 03 09:34:58.476694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 258/542] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:34:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:34:58.482476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:58.482915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:58.483664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:58.484637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:58.613622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:58.620976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8e3ead3d-1b55-4aa9-bf7d-b64df5d1ca07 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149400 Aug 03 09:34:58.621547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 285/543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:58 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:34:59.488670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:59.490818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:59.497307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:59.497749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:59.498499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:59.498927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:59.530293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e92cc0da-7415-466a-8476-3902c4c14dbb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045658 Aug 03 09:34:59.530927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 259/544] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:34:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:34:59.641712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:34:59.642328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:34:59.649535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:59.649986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:59.650750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:34:59.651185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:34:59.778459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:34:59.786022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01dd2acf-eb95-4722-9eb0-808891f73b37 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.148177 Aug 03 09:34:59.786587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 286/545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:34:59 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:00.542095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:00.544238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:00.551504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:00.551952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:00.552704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:00.553167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:00.582921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a154a12d-6387-480e-bacc-5fec2772f6ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044850 Aug 03 09:35:00.583468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 260/546] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:00.807444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:00.807983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:00.814994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:00.815441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:00.816205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:00.816678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:00.949402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:00.957824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-68642c36-29ea-4925-a0ac-3975d9211fee tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.154376 Aug 03 09:35:00.958380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 287/547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:00 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:01.596084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:01.598266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:01.604693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:01.605167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:01.605915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:01.606343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:01.634242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcc9ce49-da04-48b5-b9b3-c79cced16e91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042903 Aug 03 09:35:01.634778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 261/548] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:01.978499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:01.979093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:01.985566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:01.986014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:01.986776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:01.987208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:02.119393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:02.128679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc59293e-6f22-4628-9ca2-99fe3c42ed0f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.153987 Aug 03 09:35:02.129276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 288/549] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:01 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:02.647259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:02.649375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:02.655757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:02.656792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:02.657551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:02.657975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:02.686511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-37742264-571c-487b-8550-ab00ee43f7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043289 Aug 03 09:35:02.687573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 262/550] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:03.150361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:03.150962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:03.157601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:03.158052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:03.158823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:03.159260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:03.293678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:03.301741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4a223f08-23fc-43b5-82a3-3f6a1f41e895 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.155400 Aug 03 09:35:03.302318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 289/551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:03 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:03.699555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:03.701743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:03.708726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:03.709204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:03.709965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:03.710397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:03.741144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-519b78ce-a1a8-41e1-a26d-6a4e0a6f2c05 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045568 Aug 03 09:35:03.741696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 263/552] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:04.323622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:04.324158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:04.331607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:04.332045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:04.332790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:04.333240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:04.462761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:04.470745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e67ea1b2-ae9f-42e0-a79c-6c193c891988 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.151174 Aug 03 09:35:04.471301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 290/553] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:04 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:04.754502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:04.756625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:04.763082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:04.763526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:04.764279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:04.764703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:04.795886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7735cd5f-ecdf-489b-bd1e-bb61f6c5a33a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046191 Aug 03 09:35:04.796434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 264/554] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:05.491142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:05.491798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:05.498766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:05.499239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:05.501301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:05.501735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:05.633208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:05.640611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e785301-fbea-49f9-8556-b08d5e08abb3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.153381 Aug 03 09:35:05.641204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 291/555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:05 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:05.808394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:05.810478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:05.817116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:05.817565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:05.818324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:05.818759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:05.847874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6fcca9b6-9e10-448c-975a-26463b6416bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043478 Aug 03 09:35:05.848355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 265/556] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:06.662004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:06.662604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:06.669186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:06.669626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:06.670383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:06.670814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:06.802955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:06.810337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08461c41-18e5-48f9-a5a3-a34cbac06abc tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.152308 Aug 03 09:35:06.810901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 292/557] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:06 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:06.859971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:06.862787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:06.869256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:06.869715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:06.870475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:06.870911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:06.900206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fe433e0b-4cff-4e25-b68f-3b394c4c0c11 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Aug 03 09:35:06.900759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 266/558] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:07.832669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:07.833482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:07.840108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:07.840561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:07.841341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:07.841807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:07.912627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:07.915064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:07.921779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:07.922440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:07.923392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:07.923837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:07.956153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-77580205-762d-4dc1-86a4-b334ea2461eb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047363 Aug 03 09:35:07.956744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 267/559] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:07.981126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:07.988804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-685bfef4-a6d9-41c6-ba44-1b89218a9da8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.161054 Aug 03 09:35:07.989412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 293/560] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:07 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:08.968892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:08.971420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:08.977918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:08.978357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:08.979103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:08.979529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:09.006497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:09.010210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:09.010827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:09.011652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6440ec75-8dad-4958-bc68-f405fde06865 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046909 Aug 03 09:35:09.012214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 268/561] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:09.017692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:09.018138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:09.018901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:09.019333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:09.155155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:09.163447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-03b531e5-8367-49cf-831c-a83575ea46c8 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.156969 Aug 03 09:35:09.164017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 294/562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:09 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:10.024514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:10.026702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:10.033586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:10.034650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:10.035374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:10.035803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:10.066268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0ae9be2-7082-4dbe-a7b8-dee9b5708087 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Aug 03 09:35:10.066839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 269/563] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:10.184781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:10.185418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:10.192556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:10.193042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:10.193802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:10.194241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:10.322576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:10.330284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cf2a47a1-4455-4c2b-aed5-464869f6db9f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149102 Aug 03 09:35:10.331659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 295/564] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:10 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:11.078883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:11.082176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:11.088697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:11.089171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:11.089928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:11.090358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:11.119366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30340e58-912c-4f85-8b4e-bcabf6fa7d88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044568 Aug 03 09:35:11.119919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 270/565] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:11.351497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:11.352108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:11.358613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:11.359066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:11.359824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:11.360257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:11.494850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:11.503184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b0c26b9-2471-4ea9-8a24-e330c16af722 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.154904 Aug 03 09:35:11.506451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 296/566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:11 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:12.131887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:12.134022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:12.140460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:12.140947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:12.141703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:12.142137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:12.172986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb83cd21-2fd3-4a31-bca5-9253161b3c64 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045072 Aug 03 09:35:12.173588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 271/567] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:12.524800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:12.525467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:12.527763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=42 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:12.533085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:12.533536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:12.534650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:12.535086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:12.667169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:12.674909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-05ec1ca9-a395-43c2-9b53-7104f7d77b8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.153761 Aug 03 09:35:12.675483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 297/568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:12 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:13.185610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:13.187714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:13.194298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:13.194807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:13.195680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:13.196110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:13.225427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-48fc94df-3ee4-4952-88c3-0f6b8660dad3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043736 Aug 03 09:35:13.225986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 272/569] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:13.695388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:13.696010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:13.702455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:13.702901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:13.703659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:13.704091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:13.837578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:13.844804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a49d27d9-ed01-457a-b5dd-469ec275e19a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.153226 Aug 03 09:35:13.845387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 298/570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:13 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:14.238898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:14.241061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:14.247199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:14.247639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:14.248381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:14.248805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:14.277078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2b1ff4e5-b80a-4efc-98a7-e95044908c1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042785 Aug 03 09:35:14.277619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 273/571] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:14.866855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:14.867459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:14.873875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:14.874322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:14.875066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:14.875494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:15.005201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:15.012644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-944af527-bb7f-4be4-8a2b-b1bbc7683368 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149631 Aug 03 09:35:15.013237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 299/572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:14 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:15.289558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:15.291701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:15.298149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:15.298595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:15.299348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:15.299781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:15.328138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e10a262-6f63-4707-89e4-f34f73f21fea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043395 Aug 03 09:35:15.328617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 274/573] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:16.033960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:16.034496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:16.041114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:16.041555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:16.042316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:16.042748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:16.329168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:16.336791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0e43b874-d06c-4142-b2bf-1c47e5767bdf tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.306725 Aug 03 09:35:16.337376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 300/574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:16 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:16.342235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:16.344346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:16.351677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:16.352123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:16.352909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:16.353347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:16.382487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f5b58d5a-2244-4673-969b-14bdd9e89186 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044418 Aug 03 09:35:16.383049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 275/575] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:17.358493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:17.359133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:17.366352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:17.366798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:17.367559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:17.367993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:17.371893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:17.394045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:17.396661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:17.403203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:17.403651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:17.404410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:17.404868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:17.435211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c720fe30-29af-4604-924c-fae5f9177975 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045033 Aug 03 09:35:17.435769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 276/576] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:17.499099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:17.507144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-90d0b363-a99e-4075-9adc-265ac968ed5c tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.152484 Aug 03 09:35:17.507711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 301/577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:17 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:18.448136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:18.450276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:18.456945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:18.457387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:18.458736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:18.459131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:18.487333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c138c8e6-7d5f-4557-9012-36694b049a07 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043071 Aug 03 09:35:18.487804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 277/578] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:18.527775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:18.528378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:18.534893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:18.535329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:18.536075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:18.536526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:18.663813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:18.671262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-742a675f-3cee-444f-a821-2242a9c6ed13 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.147286 Aug 03 09:35:18.671815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 302/579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:18 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:19.499751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:19.501841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:19.508292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:19.508739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:19.509505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:19.509928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:19.538836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6820d09a-e590-4157-8f56-72f5c0aa8c3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043213 Aug 03 09:35:19.539383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 278/580] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:19.691700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:19.692302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:19.698775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:19.699240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:19.699989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:19.700410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:19.830567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:19.838447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7aa440c1-a0f1-4fab-99f2-380bcadfc961 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.150507 Aug 03 09:35:19.839002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 303/581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:19 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:20.551300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:20.554284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:20.560739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:20.561217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:20.561977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:20.562414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:20.591613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41075eeb-b4f2-4c66-a724-efb95a5d232b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044338 Aug 03 09:35:20.592153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 279/582] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:20.859031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:20.859659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:20.866878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:20.867318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:20.868077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:20.868507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:20.999374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:21.007074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba81c972-ef39-4e77-9cb6-a0b5f66abf8f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.151861 Aug 03 09:35:21.007647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 304/583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:20 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:21.603934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:21.606074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:21.612645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:21.613123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:21.613888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:21.614339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:21.643272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-adcd19f5-a38c-4519-98b8-01ba13198dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043327 Aug 03 09:35:21.643813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 280/584] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:22.027844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:22.028402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:22.034794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:22.035234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:22.035983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:22.036463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:22.166797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:22.174271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8e036191-dcc4-455e-99fe-dcd16ae6520e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.150399 Aug 03 09:35:22.174837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 305/585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:22 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:22.655769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:22.657897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:22.660151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=56 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:22.666377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:22.666821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:22.667579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:22.668005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:22.697389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2cb1ad4f-7eaa-4b39-b884-77a376fc33af tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045612 Aug 03 09:35:22.697963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 281/586] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:23.200603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:23.201268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:23.209163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:23.209968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:23.211308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:23.212112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:23.359412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:23.369218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-deff0d78-07a6-4792-8333-61a8210379ae tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.174090 Aug 03 09:35:23.369786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 306/587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:23 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:23.711018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:23.713235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:23.719919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:23.720362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:23.721168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:23.721592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:23.751559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98a38e49-a52c-46a1-acb2-cc3b182e8987 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045220 Aug 03 09:35:23.752132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 282/588] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:24.390957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:24.391562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:24.398241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:24.398686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:24.399441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:24.399870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:24.529185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:24.537282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-312f0aea-90ec-4385-b0d1-278118ddeba4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.149441 Aug 03 09:35:24.537847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 307/589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:24 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:24.764595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:24.766775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:24.773783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:24.774229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:24.774989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:24.775422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:24.805175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3763ccae-184e-432e-89ff-7d429791831a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044521 Aug 03 09:35:24.805741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 283/590] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:25.558444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:25.559061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:25.565474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:25.565915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:25.566669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:25.567095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:25.706969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:25.714670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d4b9cf8d-b1d7-4616-a08e-ade9eac9533d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.160043 Aug 03 09:35:25.715305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 308/591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:25 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:25.817493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:25.820495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:25.827028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:25.827471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:25.828316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:25.828749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:25.858754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-257d4641-f69c-40f0-bb5a-7d22713745f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045349 Aug 03 09:35:25.859303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 284/592] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:26.735440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:26.736053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:26.743302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:26.743750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:26.744529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:26.744983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:26.871597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:26.873753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:26.874255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:26.880342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:26.880998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:26.881768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:26.882170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74f323e3-7f85-4297-b789-986737d1cbab tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.150395 Aug 03 09:35:26.882272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:26.882877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 309/593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:26 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:26.895852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:26.911893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-edfb7365-2ed1-4f36-ae29-0e99887fc79b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043789 Aug 03 09:35:26.912471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 285/594] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:27.482511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:35:27.485582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:27.492725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.493419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:27.494191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.494623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:27.523359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'flavor' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:35:27.761207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce74c468-c956-4f93-bc7a-d4661b4b5c2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action" status: 200 len: 32 microversion: 2.1 time: 0.282700 Aug 03 09:35:27.761854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 310/595] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:35:27 2022] POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action => generated 32 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 09:35:27.771222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:27.771943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:27.778016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.778466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:27.779223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.779659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:27.904254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:27.904984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:27.912016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.912455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:27.913258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:27.913684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:28.051906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:28.060559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8377f49-75d3-4422-9d5d-c995dc82105a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1367 microversion: 2.1 time: 0.160647 Aug 03 09:35:28.069084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 311/596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:27 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:28.069084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:28.069084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:28.074996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:28.075441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:28.076214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:28.076643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:28.109092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a96cee24-28a0-4390-a8db-683946c5ce7a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046801 Aug 03 09:35:28.109690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 312/597] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:28.303754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:28.311967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d80eddc1-5bd7-46c3-9261-5b61542e072a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.544588 Aug 03 09:35:28.312887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 286/598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:29.081663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:29.082304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:29.088747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.089220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.089984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.090450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.121968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:29.124242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:29.132078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.132927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.133703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.134390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.165070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f3ff803-3173-4c67-949f-b3aefe2e1a15 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046902 Aug 03 09:35:29.165633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 287/599] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:29.228081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:29.235566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25bdcc7f-c2c6-4a4e-a183-7a3d4029bd65 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1557 microversion: 2.1 time: 0.157889 Aug 03 09:35:29.236132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 313/600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:29 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:29.257711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:29.258236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:29.264437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.264926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.265727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.266165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.336766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:29.337791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:29.344188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.344683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.345796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:29.346226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:29.378351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1eda0a65-032a-4e05-9c63-808de96be32e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125161 Aug 03 09:35:29.378944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 288/601] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:35:29 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:35:29.491407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:29.499681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7c217b0-1295-429b-910e-8c740e851482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.167392 Aug 03 09:35:29.500248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 314/602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:30.179012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:30.181442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:30.187837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:30.188360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:30.189167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:30.189604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:30.220293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-64ed2796-56b7-4e6d-b13a-28cb2edd9542 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046289 Aug 03 09:35:30.220878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 289/603] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:30.521763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:30.522638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:30.529176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:30.529627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:30.530726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:30.531195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:30.653409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-e2fcf6ec-c1b9-4667-b481-da59f679a237 req-757d5f61-a1b2-4290-8edc-0bccba73d50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9481377c-68db-499c-a657-afe14aabd667", "tag": "e9477d30-2366-4eaf-851e-05f42903a14b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:35:30.663919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-e2fcf6ec-c1b9-4667-b481-da59f679a237 req-757d5f61-a1b2-4290-8edc-0bccba73d50a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:30.664609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-e2fcf6ec-c1b9-4667-b481-da59f679a237 req-757d5f61-a1b2-4290-8edc-0bccba73d50a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:30.668477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:30.670806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:30.676721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-e2fcf6ec-c1b9-4667-b481-da59f679a237 req-757d5f61-a1b2-4290-8edc-0bccba73d50a service nova] Creating event network-changed:e9477d30-2366-4eaf-851e-05f42903a14b for instance 9481377c-68db-499c-a657-afe14aabd667 on hv-cinder-84456 Aug 03 09:35:30.679186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f453daa-75b9-42d7-a880-35de8f8ae09e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.161879 Aug 03 09:35:30.679890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 315/604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:30.683206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-e2fcf6ec-c1b9-4667-b481-da59f679a237 req-757d5f61-a1b2-4290-8edc-0bccba73d50a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033416 Aug 03 09:35:30.683796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 290/605] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:35:31.234353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:31.236653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:31.246372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:31.246825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:31.248373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:31.248373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:31.287922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8aa0020-8845-486b-8e01-8223bfaef503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057779 Aug 03 09:35:31.288920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 316/606] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:31.701929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:31.702642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:31.710468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:31.710932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:31.711806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:31.712244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:31.846074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:31.854071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9847710c-2bda-4a19-88cc-3bc33e21b30d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156994 Aug 03 09:35:31.854632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 291/607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:32.403519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:32.405745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:32.411799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:32.412241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:32.413025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:32.413456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:32.442082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0832780a-e3d0-410d-9bc7-81a1f32ba6a1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146340 Aug 03 09:35:32.442633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 317/608] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:32.875645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:32.876260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:32.882994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:32.883439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:32.884201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:32.884633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:33.013641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:33.022141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3bc55c8-12c9-4533-a1d6-0899c8b10977 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150543 Aug 03 09:35:33.022714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 292/609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:33.454918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:33.457331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:33.464515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:33.464993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:33.465741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:33.466164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:33.494246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-27325ce3-c4f1-41fa-a26d-f1f50d3fac0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Aug 03 09:35:33.494791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 318/610] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:34.043223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:34.043820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:34.050569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:34.051016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:34.051796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:34.052719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:34.187091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:34.195336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d8ab795-3a47-4598-ab98-c5d5864b05c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155883 Aug 03 09:35:34.195896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 293/611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:34.507764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:34.509952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:34.516394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:34.516864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:34.517629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:34.518069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:34.547629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b2e3080-6260-48ba-9892-0b99120e0e02 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043918 Aug 03 09:35:34.548182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 319/612] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:35.218194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:35.218807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:35.225757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:35.226316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:35.227072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:35.227502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:35.356774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:35.365221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-91ade517-b747-4d1d-8679-ccbd489ac97f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151269 Aug 03 09:35:35.366118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 294/613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:35.559758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:35.561838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:35.568915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:35.569382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:35.570115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:35.570537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:35.599649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-773d79d6-0b50-4bb6-90de-bce327c522a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043386 Aug 03 09:35:35.600356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 320/614] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:36.387449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:36.388079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:36.394501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:36.394937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:36.395679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:36.396905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:36.525120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:36.532970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-362b6a81-fca3-4fae-b038-5cced2bbeec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149305 Aug 03 09:35:36.533525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 295/615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:36.611622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:36.613827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:36.620380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:36.620851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:36.621648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:36.622084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:36.651673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-035f00f0-9ec1-4a06-b4e8-a6ad0f9489a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044011 Aug 03 09:35:36.652247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 321/616] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:37.555053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:37.555708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:37.562152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:37.562599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:37.563350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:37.563784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:37.663978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:37.666148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:37.672636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:37.673114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:37.673884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:37.674348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:37.696653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:37.704375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6710aa7d-09f7-4776-b852-1024d0b0233d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044907 Aug 03 09:35:37.704645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-535827d4-a5d0-422a-ad18-b1e142d42aba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153999 Aug 03 09:35:37.704974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 322/617] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:37.705479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 296/618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:38.717824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:38.719941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:38.726967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:38.727420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:38.727564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:38.727709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:38.728473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:38.728940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:38.733902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:38.734341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:38.735092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:38.735514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:38.758430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0e654594-3ff8-4514-9e83-e60ef7253692 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044562 Aug 03 09:35:38.758986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 323/619] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:38.863674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:38.872330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d8c5d121-032c-4da0-9788-9986d2e36632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149828 Aug 03 09:35:38.872917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 297/620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:39.770350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:39.772582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:39.779148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:39.779587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:39.780362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:39.780791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:39.809712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4a594f39-cd0c-41ab-9a19-edce887b671a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043286 Aug 03 09:35:39.810275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 324/621] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:39.893513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:39.894127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:39.900791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:39.901269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:39.902035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:39.902474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:40.035754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:40.044258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2065bade-0e02-4c9a-9fe4-1f2d6f624a52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154593 Aug 03 09:35:40.044845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 298/622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:40.545262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:35:40.545481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:35:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:35:40.822891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:40.824996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:40.831639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:40.832096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:40.832883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:40.833323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:40.863112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d82de0b2-4263-4429-a75e-09f11ac92753 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Aug 03 09:35:40.863665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 325/623] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:41.065151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:41.065800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:41.072782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:41.073257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:41.074004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:41.074436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:41.201444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:41.210435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-42d3b0e6-47a5-4448-b481-82fb161eda10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149287 Aug 03 09:35:41.211000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 299/624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:41.876226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:41.878485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:41.885377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:41.885822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:41.886584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:41.887012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:41.916661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2229377f-eefb-4396-95d1-1bdf5d947b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044460 Aug 03 09:35:41.917303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 326/625] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:42.332800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:42.333439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:42.340111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:42.340543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:42.341343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:42.341778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:42.480108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:42.488191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb947e81-40f1-4545-a6df-29f2482a0c4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.260455 Aug 03 09:35:42.488759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 300/626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:42.929850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:42.931955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:42.934273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=60 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:42.939664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:42.940100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:42.940869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:42.941295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:42.970756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0191919c-9c72-4fb9-a343-c9828655e8b5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045654 Aug 03 09:35:42.971226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 327/627] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:43.511028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:43.512025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:43.518648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:43.519095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:43.519858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:43.520286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:43.651129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:43.659070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8abcb8d8-41a0-4772-ba84-bed27c38d449 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151915 Aug 03 09:35:43.659633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 301/628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:43.983104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:43.985228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:43.992232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:43.992672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:43.993449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:43.993874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:44.021710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b63183c-4f56-4f35-a963-f49f159c8d30 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042561 Aug 03 09:35:44.022255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 328/629] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:44.680869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:44.681472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:44.687678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:44.688122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:44.688895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:44.689325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:44.814844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:44.822921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c7988500-ed5c-47c1-8e6b-09844aef4eaf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146696 Aug 03 09:35:44.823487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 302/630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:45.034089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:45.036215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:45.044251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:45.044698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:45.045596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:45.046033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:45.077053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c4251c93-254d-408a-9829-2ef95531ac9d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046838 Aug 03 09:35:45.077544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 329/631] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:45.844892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:45.845432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:45.851927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:45.852372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:45.853161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:45.853597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:45.856154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:45.987133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:45.995623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c32d2d05-b72c-416b-bc65-bd2247bf1871 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154945 Aug 03 09:35:45.996187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 303/632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:46.089522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:46.091679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:46.098112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.098562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.100309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.100766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.130051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-99484683-f671-4cfe-80b2-01d9be9df398 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044574 Aug 03 09:35:46.130746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 330/633] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:46.430879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:35:46.431337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:46.437626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.438067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.438816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.439240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.462046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lazy-loading 'flavor' on Instance uuid 0ab003f4-e418-44ec-93fe-e0d109021fcc {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:35:46.531968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e85771c-6821-480b-87af-4e364e20f75b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "POST /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc/action" status: 202 len: 0 microversion: 2.1 time: 0.105446 Aug 03 09:35:46.532544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 304/634] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:35:46 2022] POST /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:35:46.541348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:46.541955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:46.547971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.548424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.549202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:46.549705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:46.681752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:46.689142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29411d28-5b7f-4f74-8fb8-24bb3006c72e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152187 Aug 03 09:35:46.689710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 331/635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:47.019057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:47.019670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:47.026519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.026961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.027716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.028146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.142500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:47.144700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:47.152216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.152686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.153517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.153941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.160529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:47.168204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:47.168990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b16eddea-4f08-4f87-90d9-2770aa58274b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154667 Aug 03 09:35:47.169569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 305/636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:47.185569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7773b168-ab95-4d5f-b920-37c505474c74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046973 Aug 03 09:35:47.186149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 332/637] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:47.710993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:47.711605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:47.717862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.719194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.720008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:47.720416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:47.855748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:47.863150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd4d6110-7660-4ed4-99fa-7c5e941eab1a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156293 Aug 03 09:35:47.863710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 306/638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:48.191675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:48.192274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:48.197523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:48.198922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.199365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:48.199762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:48.200124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.200553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:48.206169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.206604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:48.207621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.208045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:48.238944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e3a4b6ae-9ba6-4f06-b249-d25e6c1c93dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045473 Aug 03 09:35:48.239523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 307/639] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:48.329564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:48.338304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d431a7af-216d-4256-9c37-e93869a7bdf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150612 Aug 03 09:35:48.338874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 333/640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:48.886686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:48.887332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:48.893345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.893787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:48.894536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:48.894965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:49.025316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:49.032741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-124e9b35-46bb-4da2-9092-1ffb65ef6dfd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150182 Aug 03 09:35:49.033325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 308/641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:49.251434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:49.253651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:49.260701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:49.261184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:49.262054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:49.262583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:49.292601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f952b85-9289-477a-9da3-4c1643383d95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045176 Aug 03 09:35:49.293166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 334/642] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:49.360325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:49.360961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:49.367297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:49.367932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:49.368684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:49.369141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:49.497996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:49.506004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01293352-a113-44aa-974f-5bfa302fa7a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150403 Aug 03 09:35:49.506505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 309/643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:50.054071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:50.055350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:50.061692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.062143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.062912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.063345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.197034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:50.204468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5640c43-d837-42f3-b3e2-b2c840210555 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154287 Aug 03 09:35:50.205070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 335/644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:50.309921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:50.312151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:50.318168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.318605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.319353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.319782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.348479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04cdeca0-4f44-4233-b3ea-7db98616a0f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042553 Aug 03 09:35:50.349048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 310/645] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:50.528520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:50.529092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:50.535739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.536184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.536986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:50.537422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:50.674661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:50.682880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a4390fd6-00bd-43e9-bd61-2f0facb50753 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.158299 Aug 03 09:35:50.683989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 336/646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:51.226530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:51.227294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:51.233817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.234264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.235021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.235474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.360640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:51.362843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:51.369322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:51.370486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.371140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.372267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.372983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.376733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3d94b2c3-a68b-4c9c-816b-f368422304b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154346 Aug 03 09:35:51.377332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 311/647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:51.402605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b00e659-0ef8-4653-8913-a73d44d71997 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045989 Aug 03 09:35:51.403160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 337/648] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:51.705267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:51.705876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:51.712796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.713260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.714021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:51.714449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:51.846557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:51.855079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12d9c107-369e-4be4-96a5-240602f2f5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153769 Aug 03 09:35:51.855640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 312/649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:52.397022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:52.397630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:52.404962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.405404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:52.406165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.406597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:52.414754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:52.416939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:52.423512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.423961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:52.424729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.425371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:52.456050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87958729-52ac-4bd3-98f2-e1b0cd19e901 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045296 Aug 03 09:35:52.456625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 313/650] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:52.541375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:52.548875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb8a9eee-d4c0-44fe-800f-7c46ff9bb3ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155729 Aug 03 09:35:52.549441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 338/651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:52.875449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:52.876057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:52.878020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=66 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:52.883348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.883845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:52.884604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:52.885060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.014627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:53.022691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1683508a-c75a-4d0f-8583-aa287eecd79d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1714 microversion: 2.1 time: 0.151102 Aug 03 09:35:53.023256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 314/652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:53.087813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:53.088304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:53.094631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.095097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.095851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.096401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.176605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Cannot 'detach_volume' instance 3d91625e-8ed4-43db-8a95-714abb859a9c while it is in vm_state rescued Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:35:53.178247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:35:53.179956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Cannot 'detach_volume' instance 3d91625e-8ed4-43db-8a95-714abb859a9c while it is in vm_state rescued Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d91625e-8ed4-43db-8a95-714abb859a9c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:35:53.180864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3d91625e-8ed4-43db-8a95-714abb859a9c while it is in vm_state rescued Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3d91625e-8ed4-43db-8a95-714abb859a9c while it is in vm_state rescued Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:35:53.182445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 409 to user: Cannot 'detach_volume' instance 3d91625e-8ed4-43db-8a95-714abb859a9c while it is in vm_state rescued {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:35:53.183797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c378fe6-077c-4522-ac86-c3a7dc699e91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 409 len: 152 microversion: 2.1 time: 0.095764 Aug 03 09:35:53.183797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 339/653] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:35:53 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 03 09:35:53.188900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:35:53.189436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:53.196126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.196579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.197364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.197799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.263629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33f11d53-b4ae-4190-859d-c37c6eee0c43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.078454 Aug 03 09:35:53.266621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 315/654] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:35:53 2022] POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 09:35:53.272395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:53.273121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:53.280142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.280653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.281506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.281938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.415780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:53.424047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e1c26c4c-640a-4aba-8ed5-023efac0e924 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1722 microversion: 2.1 time: 0.155480 Aug 03 09:35:53.424619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 340/655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:53.469807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:53.472138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:53.479514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.479959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.480759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.481215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.506591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:53.512922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6bb6beed-48fb-476c-aedc-ca5a935db60b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047935 Aug 03 09:35:53.513487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 316/656] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:53.571630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:53.572235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:53.578518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.578951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.579708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:53.580134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:53.713883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:53.721775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5204d261-93f4-46d1-b131-d166c2354863 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154636 Aug 03 09:35:53.722345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 341/657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:54.445952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:54.446553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:54.453547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.453986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.454734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.455162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.525497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:54.527827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:54.534536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.534985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.535749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.536177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.566893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3037be92-d025-438d-a4e8-b899d71d3333 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045678 Aug 03 09:35:54.567648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 342/658] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:54.592684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:54.600829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-763ccb2a-ce91-4e8d-8649-63ea717656ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1722 microversion: 2.1 time: 0.158738 Aug 03 09:35:54.601386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 317/659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:54.742984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:54.743625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:54.749642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.750083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.750840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:54.751274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:54.882719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:54.890318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ded52e6f-74f2-45df-95f8-8df92f0b51e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151217 Aug 03 09:35:54.890871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 343/660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:55.579945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:55.582076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:55.589644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.590114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:55.590916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.591346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:55.620836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-31d76a0b-79f9-4cf6-befb-dae7dcd8d428 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Aug 03 09:35:55.622247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 318/661] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:55.623572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:55.624242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:55.630738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.631184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:55.631949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.632378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:55.762233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:55.770123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-927c7175-14e8-4a1d-9f8b-82ca0b53554f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1722 microversion: 2.1 time: 0.150536 Aug 03 09:35:55.770678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 344/662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:35:55.911940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:55.912547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:55.919457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.919901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:55.920636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:55.921088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:56.051773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:56.060229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ac1081f8-69f4-465a-8b14-b45628126327 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152150 Aug 03 09:35:56.060800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 319/663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:56.633972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:56.636116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:56.642696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:56.643137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:56.643883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:56.644309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:56.673036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45778715-e3c2-4b52-984f-53b744854baa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Aug 03 09:35:56.673581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 345/664] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:56.791289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:56.791898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:56.798355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:56.798809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:56.799573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:56.800012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.045341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:57.054070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f928253f-1d99-42f4-826d-40de1b0121dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1728 microversion: 2.1 time: 0.266664 Aug 03 09:35:57.062554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 320/665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1728 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:57.077008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:57.077593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:57.082121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:57.083068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:57.084299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.084840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.085706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.086216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.089511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.089958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.090708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.091144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.169644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d60bd6b-81e3-46b2-8471-a9046ca9c73b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096580 Aug 03 09:35:57.170274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 346/666] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:35:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:35:57.332084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:57.339999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1946859c-5ba6-4814-a715-649927ae89be tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.261838 Aug 03 09:35:57.340791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 321/667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:57.685543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:57.687715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:57.693666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.694110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.694867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:57.695302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:57.725207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bda190b4-b115-4a29-a7a2-6638c67d0108 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044188 Aug 03 09:35:57.725765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 347/668] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:35:58.063701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-9975174d-e234-465b-a440-f320a6525bb7 req-da0a82a7-5fe3-4dc3-967d-43698054f76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:35:58.076446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9975174d-e234-465b-a440-f320a6525bb7 req-da0a82a7-5fe3-4dc3-967d-43698054f76f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:58.076921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-9975174d-e234-465b-a440-f320a6525bb7 req-da0a82a7-5fe3-4dc3-967d-43698054f76f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:58.091002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-9975174d-e234-465b-a440-f320a6525bb7 req-da0a82a7-5fe3-4dc3-967d-43698054f76f service nova] Creating event network-changed:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 09:35:58.096017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-9975174d-e234-465b-a440-f320a6525bb7 req-da0a82a7-5fe3-4dc3-967d-43698054f76f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041546 Aug 03 09:35:58.096591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 322/669] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:35:58.362761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:58.363905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:58.371788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:58.372439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:58.373377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:58.373811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:58.510311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:58.518209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77208d71-efcf-4040-94e9-74e44e4e5233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.159362 Aug 03 09:35:58.518791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 348/670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:58.739043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:58.741691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:58.748681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:58.749813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:58.750082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:58.750521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:58.780768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1e6ab6e5-fc3c-4030-99c5-f1c1ba2d8791 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046098 Aug 03 09:35:58.781566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 323/671] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:35:59.540309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:59.540913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:59.547316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:59.547762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:59.548527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:59.548998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:59.564382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:35:59.682919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:35:59.690342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-060b9940-17e8-435c-a8c0-ef485a476589 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154560 Aug 03 09:35:59.690897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 349/672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:35:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:35:59.793981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:35:59.795993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:35:59.802364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:59.802805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:59.803554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:35:59.803983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:35:59.833472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-866a8287-4144-4120-9d91-917bc5e091fd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Aug 03 09:35:59.834037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 324/673] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:35:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:00.111024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-6311b564-bf05-41ce-bdc6-fb852decec71 req-43ce9149-1b2c-4a07-bfaa-20890a3256ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:36:00.120424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6311b564-bf05-41ce-bdc6-fb852decec71 req-43ce9149-1b2c-4a07-bfaa-20890a3256ba service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:00.120880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6311b564-bf05-41ce-bdc6-fb852decec71 req-43ce9149-1b2c-4a07-bfaa-20890a3256ba service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:00.131826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-6311b564-bf05-41ce-bdc6-fb852decec71 req-43ce9149-1b2c-4a07-bfaa-20890a3256ba service nova] Creating event network-changed:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 09:36:00.137153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-6311b564-bf05-41ce-bdc6-fb852decec71 req-43ce9149-1b2c-4a07-bfaa-20890a3256ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029818 Aug 03 09:36:00.137771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 350/674] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:36:00.711841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:00.712441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:00.718655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:00.719132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:00.719899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:00.720363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:00.846740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:00.849225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:00.852595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:00.856638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:00.857178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:00.858002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:00.858436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:00.860388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f34bae10-865e-44a0-b945-d06af8936fa1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152809 Aug 03 09:36:00.860990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 325/675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:00.887997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f62e68e-74cd-4cb2-a39e-c228beb899e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045626 Aug 03 09:36:00.888520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 351/676] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:01.881989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:01.882607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:01.889989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:01.890437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:01.891202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:01.891636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:01.900124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:01.902328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:01.909006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:01.909451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:01.910214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:01.910644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:01.940215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4642e907-d447-4eb1-921a-8cc8dc3af3d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Aug 03 09:36:01.940790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 352/677] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:02.034427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:02.041986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c1147b63-76fe-4081-950b-6685066f7043 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.163891 Aug 03 09:36:02.042541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 326/678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:02.427018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-471d7770-12f3-465b-bd14-15b49554abea req-8521bc39-d4f5-4651-8c24-a661c84302f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "name": "network-vif-unplugged", "status": "completed", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:36:02.439385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-471d7770-12f3-465b-bd14-15b49554abea req-8521bc39-d4f5-4651-8c24-a661c84302f5 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:02.439824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-471d7770-12f3-465b-bd14-15b49554abea req-8521bc39-d4f5-4651-8c24-a661c84302f5 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:02.451913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-471d7770-12f3-465b-bd14-15b49554abea req-8521bc39-d4f5-4651-8c24-a661c84302f5 service nova] Creating event network-vif-unplugged:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:36:02.457178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-471d7770-12f3-465b-bd14-15b49554abea req-8521bc39-d4f5-4651-8c24-a661c84302f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033849 Aug 03 09:36:02.458397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 353/679] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:36:02.953197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:02.955411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:02.963053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:02.963537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:02.964298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:02.964731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:02.996465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6c5947b9-3ff6-4765-90e4-11320027a30d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047417 Aug 03 09:36:02.997055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 327/680] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:03.064642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:03.065365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:03.072686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:03.073150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:03.073903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:03.074359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:03.207605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:03.215693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3e8a407-9658-4d51-b56d-4a513a34758b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155964 Aug 03 09:36:03.216255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 354/681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:04.009611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:04.011697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:04.018239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:04.018687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:04.019438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:04.019866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:04.049058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07e54c92-2ee8-4345-b98d-176614740298 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043951 Aug 03 09:36:04.049626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 328/682] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:04.236699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:04.237331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:04.243932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:04.244368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:04.245143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:04.245574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:04.376160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:04.384163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6edcc495-bcc4-4ea9-b708-fc4d3f9f48f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151322 Aug 03 09:36:04.384714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 355/683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:05.062166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:05.064331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:05.070747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:05.071188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:05.071941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:05.072505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:05.100997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67764342-4e9f-4265-b5ee-dc7d9968002f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042790 Aug 03 09:36:05.101535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 329/684] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:05.405511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:05.406119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:05.412625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:05.413265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:05.414025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:05.415308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:05.545854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:05.553439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee626b8a-80fc-42c0-8b22-b1758b371241 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151840 Aug 03 09:36:05.554001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 356/685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:06.113965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:06.116048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:06.123240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.123681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.124428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.124887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.153922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-27ee9d91-5e8b-46ad-9763-e4ab07a8281e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043925 Aug 03 09:36:06.154465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 330/686] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:06.575245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:06.575846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:06.582263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.582697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.583701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.584122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.714283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:06.722053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e7ad79e-f6cc-4de7-8940-a2852d12a527 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151025 Aug 03 09:36:06.722991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 357/687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:06.769418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:06.769914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:06.776831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.777275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.778032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:06.778464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:06.801604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54f8f4bb-3c3c-4349-9a19-36fbcec4ffe3 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667/ips" status: 200 len: 150 microversion: 2.1 time: 0.089145 Aug 03 09:36:06.802153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 331/688] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:36:06 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:36:07.165855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:07.167947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:07.174084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:07.174530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:07.175275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:07.175753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:07.204165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b367c665-8e88-4d11-90c4-7c8c5791e503 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042778 Aug 03 09:36:07.204704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 358/689] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:07.744537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:07.745167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:07.751628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:07.752065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:07.752834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:07.753265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:07.883909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:07.891345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1038d5a9-bfa0-4ac5-897b-065b660f8224 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150790 Aug 03 09:36:07.891908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 332/690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:08.217144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:08.219319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:08.225911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:08.226353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:08.227691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:08.228158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:08.259190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e56e664-42cf-491f-b8fb-9bb9c2c8c5f2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045902 Aug 03 09:36:08.259974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 359/691] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:08.912189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:08.912799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:08.919641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:08.920085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:08.920875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:08.921313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:09.056057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:09.063982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c67f2248-97cc-4730-a094-1bcd138107a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155687 Aug 03 09:36:09.064544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 333/692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:09.271576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:09.273683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:09.280103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:09.280539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:09.281329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:09.281752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:09.311292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d9d87cc-e032-4eec-98dc-0a4863504f20 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043766 Aug 03 09:36:09.311838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 360/693] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:10.086692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:10.087796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:10.094346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:10.094790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:10.095539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:10.095966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:10.110729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:10.227238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:10.235220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-429be67d-db42-42ce-a501-ec4de3d5c673 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152758 Aug 03 09:36:10.235775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 334/694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:10.324133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:10.326304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:10.332729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:10.333472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:10.334202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:10.334626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:10.363311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-805c2f76-3947-4fb2-9ddf-b9937df9ef7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043701 Aug 03 09:36:10.363853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 361/695] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:11.256206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:11.256832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:11.263298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:11.263741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:11.264494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:11.264947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:11.375853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:11.378141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:11.384705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:11.385189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:11.385962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:11.386401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:11.403156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:11.410688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2661c5f-ae1c-4d65-984a-61095efc5333 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158268 Aug 03 09:36:11.411253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 335/696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:11.417071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9440d567-c13f-4b4f-a890-20ce8d2e4bfc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045214 Aug 03 09:36:11.417630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 362/697] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:12.429595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:12.432567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:12.434456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:12.435077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:12.439204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:12.439657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:12.440455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:12.440923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:12.441597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:12.442043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:12.442802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:12.443235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:12.470177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a494d117-7c47-4589-8eca-554329663801 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044861 Aug 03 09:36:12.470724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 336/698] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:12.578400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:12.586156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-11d1205c-165c-4cd3-8a9b-27cf9063dd11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156778 Aug 03 09:36:12.586766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 363/699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:36:13.482819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:13.485036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:13.491480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:13.491925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:13.492680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:13.493869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:13.527951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6468be1c-d5a9-4a5d-bf33-a5e8bd47f611 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049095 Aug 03 09:36:13.528493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 337/700] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:13.607563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:13.608196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:13.610641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=74 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:13.615958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:13.616398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:13.617175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:13.617607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:13.746667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:13.754144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2998e4ff-b18f-4f46-b311-85f6c31548de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150388 Aug 03 09:36:13.754703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 364/701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:14.540098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:14.542284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:14.548476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:14.548956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:14.549726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:14.550175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:14.578910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58f3dbb3-f8fb-4c1e-b04a-75faae76ca54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043014 Aug 03 09:36:14.579461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 338/702] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:14.776588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:14.777229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:14.783673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:14.784113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:14.784896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:14.785330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:14.916897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:14.924284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-10a97d25-8656-4bb3-9cda-2629ca9a0cab tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152402 Aug 03 09:36:14.924852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 365/703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:15.591460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:15.593841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:15.600645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:15.601120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:15.601884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:15.602366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:15.630842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce83a0cf-9b2c-42ef-9063-12c65f19cec5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Aug 03 09:36:15.631384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 339/704] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:15.946040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:15.946977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:15.953471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:15.953910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:15.954655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:15.955081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:16.083921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:16.092002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-90b355ef-5c9f-4924-98e7-870125d676dd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149855 Aug 03 09:36:16.092575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 366/705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:16.643563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:16.645773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:16.652798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:16.653274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:16.654026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:16.654472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:16.682555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2b4f173a-e467-4308-9f3a-cd11616ef282 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043143 Aug 03 09:36:16.683101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 340/706] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:17.116768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:17.117395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:17.124367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:17.124806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:17.125648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:17.126078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:17.141129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:17.255142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:17.262845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07dff2a5-9b6e-4d15-b091-04322b0e74de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149914 Aug 03 09:36:17.263413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 367/707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:17.694336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:17.696629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:17.703322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:17.703761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:17.704506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:17.704961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:17.734349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b8157bf-634b-4f1c-9c65-4e313321e201 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044217 Aug 03 09:36:17.734900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 341/708] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:18.283749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:18.284389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:18.291467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:18.291941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:18.292695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:18.293165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:18.430088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:18.438213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a32a6c69-6e45-427d-9409-534c2d73d5a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158297 Aug 03 09:36:18.438781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 368/709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:18.747180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:18.749299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:18.755713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:18.756152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:18.756937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:18.757366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:18.785943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8db98e92-ef35-44f4-8ffd-063e844f0e4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043291 Aug 03 09:36:18.786486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 342/710] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:19.460013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:19.460650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:19.467295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:19.467742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:19.468502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:19.468967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:19.600135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:19.608160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca163376-b057-419b-b277-8690c0480742 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152262 Aug 03 09:36:19.608733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 369/711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:19.799186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:19.801303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:19.807867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:19.808302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:19.809076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:19.809507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:19.838826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc062040-e2ea-4fac-9704-a83061c8f404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043806 Aug 03 09:36:19.839360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 343/712] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:20.630070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:20.630666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:20.637671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:20.638111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:20.638853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:20.639279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:20.770511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:20.778240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab8708ee-9384-4ab9-b948-baab4950839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151991 Aug 03 09:36:20.778804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 370/713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:20.851247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:20.853695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:20.860086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:20.860534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:20.861316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:20.861751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:20.891681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1c589bac-9d77-484c-962f-703451e41940 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044474 Aug 03 09:36:20.892153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 344/714] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:21.799535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:21.800142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:21.807820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:21.808264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:21.809059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:21.809497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:21.904229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:21.906598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:21.913154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:21.913605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:21.914344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:21.914768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:21.940915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:21.944485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-abf2e030-1964-4326-ba64-2d460aa755f6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044704 Aug 03 09:36:21.945073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 345/715] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:21.948751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e36f7761-ef9d-48f4-a56c-c04a32d0c14e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153023 Aug 03 09:36:21.949443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 371/716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:22.956968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:22.960036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:22.963299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=64 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:22.968122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:22.968557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:22.969350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:22.969780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:22.970391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:22.970992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:22.978739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:22.979172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:22.979929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:22.980353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:23.000574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7146857a-df65-46e8-a8d6-12e98ff44ee0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047473 Aug 03 09:36:23.001341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 346/717] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:23.114140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:23.121772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdb310a4-5036-4198-b6b8-70f3df4c5d0d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155592 Aug 03 09:36:23.122346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 372/718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:36:24.012564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:24.014728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:24.021247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:24.021708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:24.022452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:24.022887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:24.051790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3bb6feb6-be1e-45b3-821a-a594b71de7ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043229 Aug 03 09:36:24.052354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 347/719] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:24.147908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:24.148511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:24.155347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:24.155775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:24.156533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:24.157007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:24.527508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:24.535075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0a25259-79d2-4d3e-beb6-8d7f05c3e9ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.395603 Aug 03 09:36:24.535654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 373/720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:25.064308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:25.066492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:25.073721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:25.074166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:25.074935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:25.075363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:25.113004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cc4f11c8-f558-4b72-8539-dcd65e654d46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052565 Aug 03 09:36:25.113607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 348/721] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:25.557674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:25.558533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:25.565308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:25.565742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:25.566497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:25.566922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:25.727132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:25.736753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d67722d-f472-4bc9-bd2f-ab8d5af8d445 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.182195 Aug 03 09:36:25.736753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 374/722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:26.126341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:26.128437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:26.136171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:26.136631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:26.137411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:26.137842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:26.169845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12f590a0-d60f-4cf7-b9aa-c0174b0d4383 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047563 Aug 03 09:36:26.170406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 349/723] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:26.760560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:26.761293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:26.767728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:26.768170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:26.768961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:26.769409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:26.901343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:26.908902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-209b3354-2635-485c-8e2a-a898df5f313e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153860 Aug 03 09:36:26.909475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 375/724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:27.182523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:27.184699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:27.191080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:27.191521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:27.192267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:27.192695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:27.221996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d845b660-b6f8-4d78-ad3b-8851e4ae1d54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043673 Aug 03 09:36:27.222663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 350/725] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:27.930177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:27.930709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:27.938069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:27.938515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:27.939276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:27.939710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:28.069425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:28.077014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-469d1a0d-c9ff-4909-9ec3-486fc8a419e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150809 Aug 03 09:36:28.077572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 376/726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:28.235455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:28.237525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:28.243954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:28.244558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:28.245328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:28.245756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:28.249316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:28.274512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15f2d0c7-ebd7-48d9-8009-899104a26513 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043077 Aug 03 09:36:28.275064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 351/727] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:29.099170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:29.099777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:29.106845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:29.107285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:29.108031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:29.108455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:29.240683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:29.248914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0cdb8f1e-07af-46f8-888d-da4296a00d65 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153661 Aug 03 09:36:29.249477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 377/728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:29.286378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:29.288482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:29.295495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:29.295943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:29.296694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:29.297144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:29.326009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1022b657-9ed3-4851-b212-9a771cfd0b84 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043480 Aug 03 09:36:29.326482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 352/729] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:30.270331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:30.271583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:30.278960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:30.279414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:30.280188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:30.280621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:30.339159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:30.341437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:30.350170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:30.350851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:30.351671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:30.352068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:30.384383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d760034-800f-4f67-ae52-b6b26b354bf5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050128 Aug 03 09:36:30.385439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 353/730] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:30.414503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:30.422725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f1797b6e-e772-4b69-93de-44f45bcbd590 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156128 Aug 03 09:36:30.423351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 378/731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:31.397393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:31.399598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:31.406573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:31.407014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:31.407797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:31.408226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:31.439146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f34a0f45-30dc-4f8c-acdb-e6cbd152d162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045845 Aug 03 09:36:31.439711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 354/732] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:31.444851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:31.445455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:31.452505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:31.452990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:31.453813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:31.454240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:31.585744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:31.593255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aea60444-0813-4b7a-a08a-a322ea33056a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152256 Aug 03 09:36:31.593819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 379/733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:32.451898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:32.454089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:32.460773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:32.461244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:32.461995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:32.462426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:32.490962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04b72c08-3ef7-42c4-9ec6-ca38bc53b80f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043743 Aug 03 09:36:32.491504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 355/734] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:32.614406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:32.615008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:32.622126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:32.622566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:32.623315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:32.623741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:32.753077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:32.761411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b97d1da-2ced-40ff-954b-07cd6145ce79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150843 Aug 03 09:36:32.761978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 380/735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:33.503769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:33.505900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:33.512987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:33.513431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:33.514177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:33.514603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:33.543535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8220b87d-7924-4ff2-87d5-426370469d44 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043774 Aug 03 09:36:33.544074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 356/736] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:33.782629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:33.783274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:33.789847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:33.790294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:33.791054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:33.792190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:33.921549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:33.928933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-05a1e450-89a0-4fc8-95c6-4c0acd1c08d1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150255 Aug 03 09:36:33.929504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 381/737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:34.555007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:34.558210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:34.564666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:34.565142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:34.565897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:34.566326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:34.596197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9eaad8a9-7941-46bf-93b1-e72c6a7bcd91 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045164 Aug 03 09:36:34.596742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 357/738] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:34.952073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:34.952680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:34.959182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:34.959860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:34.960614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:34.961062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:35.096153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:35.103628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-75b90b20-4ace-40a7-8e08-c6e2b1ca45a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156170 Aug 03 09:36:35.105049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 382/739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:34 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:35.609526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:35.611824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:35.618691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:35.619135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:35.620653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:35.621471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:35.653542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ed8f4fe1-f848-4bed-bd25-5e1534dde61a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048768 Aug 03 09:36:35.654105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 358/740] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:36.126156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:36.126754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:36.133194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:36.133629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:36.134374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:36.134803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:36.272255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:36.279927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f1106e09-7b97-439d-8b69-a031131e2c7e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.157605 Aug 03 09:36:36.280500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 383/741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:36.665955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:36.668989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:36.676120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:36.676583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:36.677405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:36.677838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:36.708687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ad0a67a0-20c3-4fc8-bd23-812d0f1abad2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046705 Aug 03 09:36:36.709265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 359/742] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:37.300604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:37.301237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:37.308219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:37.308602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:37.309383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:37.309817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:37.312300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:37.444059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:37.451824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f2bc0c9-db02-4787-93fd-ed6c43534d3a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155082 Aug 03 09:36:37.452397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 384/743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:37.721541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:37.723651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:37.730758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:37.731201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:37.731952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:37.732379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:37.761014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ee72e56-1343-4805-b32f-26499af64a2a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Aug 03 09:36:37.761554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 360/744] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:38.473316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:38.473927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:38.480586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:38.481063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:38.481825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:38.482263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:38.610642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:38.618141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-09b59205-8ca2-4390-8303-64f614effb42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148682 Aug 03 09:36:38.618736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 385/745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:38.773551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:38.775682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:38.782242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:38.782684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:38.783433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:38.783858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:38.811982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5c579e5f-6391-43e0-a41f-6e484d98c3c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042522 Aug 03 09:36:38.812520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 361/746] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:39.641630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:39.642629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:39.650164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:39.650601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:39.651991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:39.652603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:39.780118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:39.787812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-62991582-1749-4de8-ac38-e6dc95132b22 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151078 Aug 03 09:36:39.788372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 386/747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:39.825826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:39.827973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:39.834468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:39.835171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:39.835937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:39.836368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:39.864852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-80831c24-ed68-477f-a88a-f090b726e745 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043915 Aug 03 09:36:39.865397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 362/748] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:40.809108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:40.809915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:40.817144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:40.817591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:40.818362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:40.818796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:40.877457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:40.879597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:40.887597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:40.888238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:40.889094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:40.889590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:40.919025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-957d4bf6-c659-4939-80b7-62915c3b51f0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Aug 03 09:36:40.919791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 363/749] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:40.954432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:40.962134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93b400ba-297a-4855-b3d5-3cf61c2113f3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.157809 Aug 03 09:36:40.962705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 387/750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:41.931733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:41.934412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:41.942064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:41.942512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:41.943276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:41.943711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:41.973783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af699886-f1ec-48fd-8ccb-1066bd8adf34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046047 Aug 03 09:36:41.974332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 364/751] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:41.984102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:41.984705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:41.991192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:41.991602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:41.992350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:41.992775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:42.124504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:42.132048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72ad2630-f959-4301-8fb5-c8405112b8bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151818 Aug 03 09:36:42.132615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 388/752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:42.986770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:42.989084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:42.996305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:42.996924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:42.997730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:42.998108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:43.026930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58c85aa3-188b-4b94-99dc-21403887423c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043645 Aug 03 09:36:43.027594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 365/753] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:43.154238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:43.154843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:43.161789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:43.162239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:43.163010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:43.163445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:43.298381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:43.305975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a7a6e4c-54b1-4608-8c05-8f4ea9551187 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156133 Aug 03 09:36:43.306539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 389/754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:44.039905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:44.042115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:44.048661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:44.049139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:44.049906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:44.050345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:44.083066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6281ece-0d42-48aa-adc8-25cd921025d3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047328 Aug 03 09:36:44.083620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 366/755] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:44.328039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:44.328594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:44.330997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=52 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:44.337237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:44.337680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:44.338436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:44.338881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:44.468877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:44.476700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-09e1e22b-027a-46b1-be73-7fd3e77ca079 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152994 Aug 03 09:36:44.477302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 390/756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:44 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:45.096127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:45.098255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:45.104782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:45.105723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:45.106464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:45.106903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:45.131472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:45.137272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4209e4e5-1965-457f-9707-aac502e2b8c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Aug 03 09:36:45.137832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 367/757] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:45.498915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:45.499522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:45.505966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:45.506404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:45.507157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:45.507585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:45.645011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:45.653238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cec2886-d699-4472-80e8-653df59694a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158519 Aug 03 09:36:45.653808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 391/758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:46.150105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:46.152597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:46.159002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:46.159448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:46.160207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:46.160645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:46.189999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-664ec8d5-fd66-4f25-b8bb-a239421a69fe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044146 Aug 03 09:36:46.190550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 368/759] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:46.674712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:46.675342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:46.681816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:46.682267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:46.683002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:46.684021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:46.816059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:46.823522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9e2d6b6-63ed-4c9b-8f5d-3c796aca7ced tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152724 Aug 03 09:36:46.824252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 392/760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:47.202515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:47.204631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:47.211533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:47.211985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:47.212747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:47.213211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:47.243065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26d7789a-80c4-4761-9472-9c44e4d84118 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044620 Aug 03 09:36:47.243620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 369/761] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:47.844590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:47.845404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:47.851855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:47.852295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:47.853076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:47.853506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:47.987785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:47.995214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07975b6b-b545-43bc-95b1-488f3dda6c08 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154508 Aug 03 09:36:47.995849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 393/762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:48.255750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:48.257903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:48.265361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:48.265811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:48.266575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:48.267012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:48.298052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-744f4ed1-4050-494d-b81f-4e9f958ef162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046357 Aug 03 09:36:48.298610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 370/763] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:49.021389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:49.022011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:49.029163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:49.029805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:49.031016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:49.033247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:49.173322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:49.180656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a1563513-eb59-4675-9282-dcb75b6adf21 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.163226 Aug 03 09:36:49.181253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 394/764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:49.310654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:49.312694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:49.319356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:49.319844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:49.320605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:49.321129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:49.351411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5b972de3-1c90-4a4a-b63f-fe739294a2f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044935 Aug 03 09:36:49.352079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 371/765] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:50.206458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:50.207013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:50.214277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:50.214866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:50.215880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:50.216370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:50.350644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:50.358267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae82e6b7-e007-4bab-be82-bdf27371273e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155862 Aug 03 09:36:50.359120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 395/766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:50.363691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:50.365828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:50.372714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:50.373257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:50.374012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:50.374533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:50.403476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2ff320c-3519-4907-9e58-cf7d433cd961 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043768 Aug 03 09:36:50.404016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 372/767] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:51.380572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:51.381200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:51.387603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:51.388045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:51.388791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:51.389247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:51.416180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:51.419732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:51.426839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:51.427288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:51.428067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:51.428512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:51.461933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d60bb598-2e72-4bd6-9b8e-87c85b66bb18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049894 Aug 03 09:36:51.462732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 373/768] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:51.672138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:51.679593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-85a60185-2eb7-4d5f-9df8-7c76fa6eaf27 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.302919 Aug 03 09:36:51.680150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 396/769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:52.475206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:52.477433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:52.484768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:52.485271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:52.486113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:52.486611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:52.516584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e05ccf7-4f5a-4cc0-876e-4847c7e33de4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045964 Aug 03 09:36:52.517186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 374/770] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:52.701124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:52.701717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:52.708124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:52.708562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:52.709343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:52.709768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:52.840173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:52.847527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8e118372-24ff-4543-b969-b12ca2d7fa66 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150993 Aug 03 09:36:52.848255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 397/771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:53.529299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:53.531484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:53.533837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=58 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:53.539107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:53.539553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:53.540308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:53.540760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:53.569634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02a6c4a5-e3b3-466a-a26e-818b0928099a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044957 Aug 03 09:36:53.570178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 375/772] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:53.870611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:53.871732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:53.877972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:53.878421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:53.879183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:53.879618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:54.010012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:54.018724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-44169948-941c-4581-9419-431df9cd417e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151906 Aug 03 09:36:54.019278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 398/773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:54.582984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:54.585177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:54.592566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:54.593056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:54.593819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:54.594252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:54.624013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a058da78-2050-402a-a06e-6de317674d6d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Aug 03 09:36:54.624566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 376/774] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:55.039695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:55.040302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:55.047075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:55.047514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:55.048302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:55.048728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:55.182537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:55.190777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d0ed4bc-e919-43cb-82aa-cd0f9a277d23 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154880 Aug 03 09:36:55.191339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 399/775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:55.635922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:55.638789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:55.645234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:55.645687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:55.646418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:55.646844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:55.674585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5744060a-44a9-4913-b9cb-923addcc58e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042705 Aug 03 09:36:55.675139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 377/776] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:56.212260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:56.212885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:56.219983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:56.220420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:56.221196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:56.221621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:56.352877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:56.355055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:36:56.362655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a81210bd-725b-49e0-8876-e4de8c3dd17b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154460 Aug 03 09:36:56.363222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 400/777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:56.687128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:56.689241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:56.695673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:56.696122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:56.696906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:56.697344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:56.727192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c21747cd-5591-40d4-a1f9-28260bd8c4a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044298 Aug 03 09:36:56.727740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 378/778] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:57.383975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:57.384570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:57.391938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:57.392373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:57.393149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:57.393580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:57.526126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:57.533841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-90ecfe81-b037-469a-a908-2d39ee5fd421 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153802 Aug 03 09:36:57.534400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 401/779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:57.739606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:57.741672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:57.748348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:57.748791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:57.749568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:57.749993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:57.778798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e9239f6a-26d1-4e52-8750-bcd7c00dc8aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043237 Aug 03 09:36:57.779337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 379/780] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:36:58.555379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:58.555980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:58.562753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:58.563193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:58.563970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:58.564399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:58.695662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:58.703177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b030f36d-f675-4360-95fb-37a3481abb8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151657 Aug 03 09:36:58.703737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 402/781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:36:58.790705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:58.793142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:58.799537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:58.799981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:58.800730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:58.801181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:58.829608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-617d99aa-39c1-4926-9878-cd3ba74fc0dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042816 Aug 03 09:36:58.830092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 380/782] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:36:59.725427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:59.726045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:59.733208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:59.733657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:59.734422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:59.734863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:59.842870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:36:59.845099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:36:59.851654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:59.852096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:59.852880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:36:59.853316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:36:59.869117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:36:59.877197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-759fa4a1-4c52-454c-a633-0e72943a42f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155647 Aug 03 09:36:59.877771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 403/783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:36:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:36:59.884360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a6c7943b-34f0-4f56-ae94-7ca0dfceecd5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046056 Aug 03 09:36:59.884929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 381/784] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:36:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:00.897085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:00.898890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:00.899370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:00.899484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:00.905907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:00.906261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:00.906382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:00.906706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:00.907110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:00.907465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:00.907573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:00.907897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:00.937741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72703cb2-3630-4017-9b19-4d84bf57f03a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044673 Aug 03 09:37:00.938295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 404/785] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:01.039119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:01.047043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-328f13dc-f216-498e-8012-08d63f4d0856 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151952 Aug 03 09:37:01.047624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 382/786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:01.949807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:01.952014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:01.958445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:01.958888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:01.959642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:01.960071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:01.989368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f033c7ee-046f-44de-bcad-76f9cc540323 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043902 Aug 03 09:37:01.989907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 405/787] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:02.068496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:02.069131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:02.076377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:02.076835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:02.077581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:02.078009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:02.208106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:02.216048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5577e56e-651a-4fc8-bb1a-5cbf8c7b4a76 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151385 Aug 03 09:37:02.216647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 383/788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:03.001849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:03.003993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:03.010439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:03.010885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:03.011703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:03.012078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:03.040604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a64df44-6cbc-4d3d-bf0f-49284b13ff75 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042756 Aug 03 09:37:03.041187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 406/789] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:03.238762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:03.239378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:03.245843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:03.246359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:03.247216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:03.247656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:03.262663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:03.380085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:03.388102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9731f19e-f8e0-4335-83b0-f00d027b45b2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153250 Aug 03 09:37:03.388675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 384/790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:04.054083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:04.056286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:04.063990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:04.064608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:04.065724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:04.066306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:04.097201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c29e53cf-17ff-453c-8674-d59b360db762 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047132 Aug 03 09:37:04.097754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 407/791] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:04.409568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:04.410175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:04.416557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:04.417030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:04.417863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:04.418292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:04.546607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:04.554025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67940cae-5036-4593-8b51-ebb16e6621d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148304 Aug 03 09:37:04.554590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 385/792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:05.110406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:05.112545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:05.119031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:05.119471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:05.120217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:05.120645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:05.149769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-69e6d81a-e2f2-42f7-b42f-9b21b3cc3525 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043334 Aug 03 09:37:05.150328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 408/793] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:05.575777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:05.576421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:05.582907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:05.583353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:05.584131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:05.584563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:05.717755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:05.725155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1df9ec31-ce7c-4da3-a0c6-427354067a8e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153518 Aug 03 09:37:05.725715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 386/794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:06.162674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:06.164803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:06.171802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.172248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.173135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.173570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.201871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-711d3096-15a5-41f3-9e87-ac56a1d45d72 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043200 Aug 03 09:37:06.202462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 409/795] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:06.747977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:06.748543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:06.755005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.755446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.756199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.756630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.886812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:06.894404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c7a9cbe2-afe4-4e72-94fd-8bdaf2049424 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151228 Aug 03 09:37:06.894971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 387/796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:06.917983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:06.919048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:06.925035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.925475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.926219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:06.926646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:06.950545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:37:07.025844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-42a654c3-acd5-4e67-b67f-0c26f75e429f tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 204 len: 0 microversion: 2.1 time: 0.111340 Aug 03 09:37:07.026541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 410/797] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:37:06 2022] DELETE /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:37:07.035586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:07.036199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:07.042221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.042678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:07.043661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.044096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:07.178445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:07.186354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ad9aa1c-ab2a-4ec8-b4f7-d4fbaf783583 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1682 microversion: 2.1 time: 0.154629 Aug 03 09:37:07.186926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 388/798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:07 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:07.214242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:07.217598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:07.223973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.224415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:07.225203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.225636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:07.255956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d154fba6-94ac-4836-8d5b-3284b387fb45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046270 Aug 03 09:37:07.257055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:37:07.257274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 411/799] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:07.257419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:37:07.916093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:07.916684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:07.923393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.923838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:07.924594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:07.925048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:08.054468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:08.062592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40c0bd04-6e53-4695-90b4-c34031e3bfdf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150350 Aug 03 09:37:08.063160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 389/800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:08.209639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:08.210164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:08.216833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:08.217413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:08.218013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:08.218442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:08.269736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:08.272169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:08.278538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:08.278972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:08.279803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:08.280293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:08.312084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c57af67e-deec-4085-a61e-49a42b636406 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047719 Aug 03 09:37:08.312657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 390/801] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:08.355013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:08.363455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-597799bb-b724-4a4c-a9ee-5183f5ae5714 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1682 microversion: 2.1 time: 0.157948 Aug 03 09:37:08.364073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 412/802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:08 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:09.084248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:09.084882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:09.091895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.092445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.093234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.093673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.324301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:09.326880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:09.333482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.333998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.334763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.335189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.340057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:09.348408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6d70e7c3-6efe-4906-a0ee-bfa1956a28ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.268067 Aug 03 09:37:09.361404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 391/803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:09.366262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-092b8462-b06e-4b18-8746-62328afe52bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045864 Aug 03 09:37:09.366817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 413/804] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:09.385667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:09.386300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:09.392215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.392659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.393458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.393895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.476309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:09.484623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-be2a25c8-1a8d-45af-a6e5-a83fbf1b72a4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 200 len: 1614 microversion: 2.1 time: 0.102727 Aug 03 09:37:09.488273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 392/805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:09 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:09.639982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-a6b77369-b358-4a26-a731-fba7414c0976 req-121fecba-14d7-47eb-8fed-179a88d1953d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9481377c-68db-499c-a657-afe14aabd667", "name": "network-vif-deleted", "tag": "e9477d30-2366-4eaf-851e-05f42903a14b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:09.651628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a6b77369-b358-4a26-a731-fba7414c0976 req-121fecba-14d7-47eb-8fed-179a88d1953d service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:09.652307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-a6b77369-b358-4a26-a731-fba7414c0976 req-121fecba-14d7-47eb-8fed-179a88d1953d service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:09.665963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-a6b77369-b358-4a26-a731-fba7414c0976 req-121fecba-14d7-47eb-8fed-179a88d1953d service nova] Creating event network-vif-deleted:e9477d30-2366-4eaf-851e-05f42903a14b for instance 9481377c-68db-499c-a657-afe14aabd667 on hv-cinder-84456 Aug 03 09:37:09.672138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-a6b77369-b358-4a26-a731-fba7414c0976 req-121fecba-14d7-47eb-8fed-179a88d1953d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124511 Aug 03 09:37:09.672763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 414/806] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:37:10.371641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:10.372343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:10.379239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:10.379784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.379896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.380688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.381058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.382024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:10.389001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.389532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.390367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.390970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.423902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a0601b53-00e8-4f20-bc02-a4a180fd7223 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049335 Aug 03 09:37:10.424725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 415/807] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:10.507510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:10.508359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:10.514800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.515491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.516275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:10.516707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:10.527947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:10.532001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 HTTP/1.1 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:37:10.533759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:37:10.535118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '9481377c-68db-499c-a657-afe14aabd667'} Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:37:10.535877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:37:10.537138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:37:10.538576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:37:10.538576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e3b0976-b619-42ed-9306-623db6938bbe tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 404 len: 111 microversion: 2.1 time: 0.031636 Aug 03 09:37:10.538576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 416/808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:10 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:37:10.541939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83b14dcc-a89d-4804-88f9-decf04d4331f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.174129 Aug 03 09:37:10.542772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 393/809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:10.544031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0d218ad6-335d-4470-985f-86cdc6c417b4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '.version_select at 0x7fb998c3d9d0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:10.567242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0d218ad6-335d-4470-985f-86cdc6c417b4 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065862670" status: 202 len: 0 microversion: 2.1 time: 0.026829 Aug 03 09:37:10.567822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 417/810] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 3 09:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1065862670 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:37:11.195575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0af23f49-88d4-4808-8bb1-b01c9d76a2b6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: .version_select at 0x7fb998c221f0>, body: {"keypair": {"name": "tempest-keypair-461593132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqgc6++K5ApYum69n/XAKlIIN5Y5NsGBRqhTffDnsXC/nDbqa/XFpxOrZQoKyRlG1ZGRtBpostbBNpBSUIDPi/YsPwmMo2J0zbkvURV6vKMOZPHYSgSIYfMSrCHwg5n5A=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:11.211293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-0af23f49-88d4-4808-8bb1-b01c9d76a2b6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:37:11.215368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-0af23f49-88d4-4808-8bb1-b01c9d76a2b6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:37:11.237984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0af23f49-88d4-4808-8bb1-b01c9d76a2b6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046227 Aug 03 09:37:11.238576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 394/811] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:37:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:37:11.436973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:11.439058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:11.445803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:11.446241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:11.446992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:11.447416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:11.451927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:11.479182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61f631e8-2c91-4ef4-9742-958be0f553dd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047450 Aug 03 09:37:11.479741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 418/812] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:11.564662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:11.565299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:11.571306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:11.571964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:11.572729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:11.573179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:11.804460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:11.812252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b51dbd13-83f7-4d09-b5d3-85470c086235 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.252133 Aug 03 09:37:11.812919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 395/813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:12.492334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:12.493819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:12.500717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:12.501216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:12.502000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:12.502427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:12.532421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-552341020", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b08b9e0-74e3-4321-8eca-779df9e19114"}], "security_groups": [{"name": "tempest-securitygroup--1877004426"}], "key_name": "tempest-keypair-461593132", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:12.533679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bbbde638-6f87-495f-8d40-37d25969508e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045984 Aug 03 09:37:12.534519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 419/814] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:12.636239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] validate_networks() for [('1b08b9e0-74e3-4321-8eca-779df9e19114', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:37:12.895261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:12.895809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:12.901738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:12.902179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:12.902929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:12.903357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:13.035212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:13.042867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d79b277-ade4-4d5f-94f4-84bf318c2282 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151601 Aug 03 09:37:13.043453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 420/815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:13.056044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:37:13.056468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:37:13.056983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:37:13.057399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:37:13.057810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:37:13.067456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:13.067904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:13.068701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:13.069166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:13.085372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:37:13.089746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Getting quotas for user a3231c7faed9467e9dad37559ff342ce and project 733f2d7dcb854bba87efcf08912c40f8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:37:13.100970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:37:13.103246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:37:13.150531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07709f9b-f63b-4ea6-8b7c-5cbfc3fe7c61 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623075 Aug 03 09:37:13.151106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 396/816] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 09:37:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 09:37:13.162215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6800612f-8553-4c2d-9cc8-7c024f3f79a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:13.162862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6800612f-8553-4c2d-9cc8-7c024f3f79a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:13.220769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6800612f-8553-4c2d-9cc8-7c024f3f79a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:13.227771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6800612f-8553-4c2d-9cc8-7c024f3f79a5 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1240 microversion: 2.1 time: 0.069459 Aug 03 09:37:13.228469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 421/817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:13 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:13.545799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:13.548196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:13.556959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:13.557415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:13.558178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:13.558783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:13.587994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90e4ad1e-819a-4009-843a-6951a45aabd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046783 Aug 03 09:37:13.588562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 397/818] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:14.172641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:14.173352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:14.182120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.182834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.183822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.184458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.250140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:14.251678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:14.259746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.260566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.261660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.262304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.329678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:14.338495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f12b8dac-95f5-4367-b6c0-e488ac04958f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.276712 Aug 03 09:37:14.339481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 422/819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:14.341258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:14.353170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce9e317a-3f19-4476-ae8e-1231ad6d7240 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1310 microversion: 2.1 time: 0.107510 Aug 03 09:37:14.353728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 398/820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:14 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:14.601836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:14.604133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:14.606018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:14.611758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.612208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.613029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:14.613442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:14.643461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cfdb380a-d772-40a9-bfbc-5fb3276d36ed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045570 Aug 03 09:37:14.644035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 423/821] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:15.361397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:15.361995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:15.368820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.369315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.370082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.370510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.375244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:15.376407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:15.383039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.383699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.384782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.385498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.523119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:15.531086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-acc3dce6-78d4-4703-a3b4-7466fe6f9f56 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.160116 Aug 03 09:37:15.531641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 424/822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:15 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:15.572528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:15.581115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f153702-fd20-4d5a-b1c7-02c72cd47c1c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.223858 Aug 03 09:37:15.581910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 399/823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:15.618546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-f9743b10-a0d2-40bb-9386-439694e1a2b6 req-ee40927e-487b-4d0e-96ad-ac36ef6c65cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac35a50-3b9f-41d8-8945-bebc20576b88", "tag": "7d2b7459-6442-4a92-b3a9-d4a50c96f1a1"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:15.629256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f9743b10-a0d2-40bb-9386-439694e1a2b6 req-ee40927e-487b-4d0e-96ad-ac36ef6c65cb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.629789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f9743b10-a0d2-40bb-9386-439694e1a2b6 req-ee40927e-487b-4d0e-96ad-ac36ef6c65cb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.641784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-f9743b10-a0d2-40bb-9386-439694e1a2b6 req-ee40927e-487b-4d0e-96ad-ac36ef6c65cb service nova] Creating event network-changed:7d2b7459-6442-4a92-b3a9-d4a50c96f1a1 for instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 on hv-cinder-84456 Aug 03 09:37:15.646808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-f9743b10-a0d2-40bb-9386-439694e1a2b6 req-ee40927e-487b-4d0e-96ad-ac36ef6c65cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032364 Aug 03 09:37:15.647509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 425/824] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:37:15.656829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:15.659027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:15.665392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.665833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.666606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:15.667035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:15.697921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-57b92d53-b4a6-45c6-90e3-9a8523837528 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046228 Aug 03 09:37:15.698487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 400/825] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:16.553511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:16.554207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:16.560280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.561374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.562177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.562622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.603280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:16.603894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:16.610559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.611007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.611775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.612211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.694904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:16.703227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ffcad4de-8115-450a-b308-1762d4ba317a tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.154458 Aug 03 09:37:16.703804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 426/826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:16 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:16.709649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:16.711773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:16.718135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.718577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.719335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:16.719762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:16.750083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9becd23-06a4-4b4f-af8f-cb4f637dd0de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Aug 03 09:37:16.750457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:16.750639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 427/827] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:16.758131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81aec1a7-cbd0-4a74-9b08-91b7a1648047 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158729 Aug 03 09:37:16.758689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 401/828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:17.724573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:17.725151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:17.731530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.731979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.733282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.733907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.762476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:17.764776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:17.771236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.771684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.772527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.772990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.800021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:17.805232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1181eb00-995a-46bd-9364-5cf3ab91c4ca tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046958 Aug 03 09:37:17.809828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 402/829] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:17.810421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:17.811721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:17.817621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.818153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.818836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:17.819436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:17.871370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:17.879510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b85ebdc-8bac-41a0-b87e-d439e549cf27 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.158888 Aug 03 09:37:17.880076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 428/830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:17 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:17.953228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:17.960772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a98d436c-e502-46e3-97a8-01582a4df9d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154027 Aug 03 09:37:17.961363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 403/831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:18.817379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:18.819612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:18.826164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.826743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:18.827503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.827928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:18.858696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e81fa290-2299-41c2-be29-74ef5d998a14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045212 Aug 03 09:37:18.859247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 429/832] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:18.900676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:18.901327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:18.908649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.909127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:18.909899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.910333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:18.983980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:18.984580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:18.990725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.991172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:18.991927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:18.992353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:19.041060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:19.048591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7150ad88-c374-4682-911e-0ada820d034e tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.151836 Aug 03 09:37:19.049172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 404/833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:18 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:19.130903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:19.138365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eaff420c-dd1e-4674-8133-6110878f45de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158690 Aug 03 09:37:19.139475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 430/834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:19.871129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:19.873877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:19.879933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:19.880389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:19.881179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:19.881613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:19.911884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-be2e5400-724f-4d2f-a6c9-7183822dddef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044704 Aug 03 09:37:19.912543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 405/835] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:20.069531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:20.070135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:20.076736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.077203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.077954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.078383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.160607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:20.161250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:20.167302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.167754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.168523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.168987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.210863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:20.219370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-09c4c9c2-dcd1-4eed-bf9a-1c4bc0b49912 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.153607 Aug 03 09:37:20.220159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 431/836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:20 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:20.306942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:20.315122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f0559fd-68e9-44a0-920d-15aca051fb92 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158436 Aug 03 09:37:20.315692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 406/837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:20.829720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-f53fd719-c558-4a28-8377-2f9fa2afa045 req-017f4241-c31f-4a58-bd34-3396eb23e9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac35a50-3b9f-41d8-8945-bebc20576b88", "name": "network-vif-plugged", "status": "completed", "tag": "7d2b7459-6442-4a92-b3a9-d4a50c96f1a1"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:20.840091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f53fd719-c558-4a28-8377-2f9fa2afa045 req-017f4241-c31f-4a58-bd34-3396eb23e9de service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.840603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-f53fd719-c558-4a28-8377-2f9fa2afa045 req-017f4241-c31f-4a58-bd34-3396eb23e9de service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.852620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-f53fd719-c558-4a28-8377-2f9fa2afa045 req-017f4241-c31f-4a58-bd34-3396eb23e9de service nova] Creating event network-vif-plugged:7d2b7459-6442-4a92-b3a9-d4a50c96f1a1 for instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 on hv-cinder-84456 Aug 03 09:37:20.857715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-f53fd719-c558-4a28-8377-2f9fa2afa045 req-017f4241-c31f-4a58-bd34-3396eb23e9de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089799 Aug 03 09:37:20.858580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 432/838] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:37:20.924788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:20.927011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:20.933583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.934096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.934915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:20.935409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:20.965976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a1edf97d-3cca-4868-8e8f-98b57c525326 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045514 Aug 03 09:37:20.966779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 407/839] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:21.241407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:21.242020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:21.249905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.250353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:21.251115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.251550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:21.337003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:21.337883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:21.344271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.344708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:21.345515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.345940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:21.384273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:21.392183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-692baf39-aa7e-4e49-a92e-3055294d7a41 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.155044 Aug 03 09:37:21.392758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 433/840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:21 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:21.476300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:21.484598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8ce2e975-eed1-480f-9cb8-ff8e217cd077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151494 Aug 03 09:37:21.485185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 408/841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:21.979075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:21.981329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:21.988126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.988569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:21.989359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:21.989791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:22.018381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d5d232a6-d80a-47be-8044-8101c08e73c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043392 Aug 03 09:37:22.018915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 434/842] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:22.412431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:22.413071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:22.419550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:22.420654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:22.421647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:22.422085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:22.507784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:22.508752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:22.516243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:22.516689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:22.517491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:22.517920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:22.565007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:22.572595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26bb0d06-ccb5-4d4b-9db5-b4a3b69d3aca tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1366 microversion: 2.1 time: 0.163977 Aug 03 09:37:22.573344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 409/843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:22 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:22.662389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:22.670085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cf1eb9db-f214-4d6f-81e8-318647eb5cb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.167071 Aug 03 09:37:22.670584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 435/844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:23.031326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:23.033420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:23.039415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.039861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.040626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.041093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.072428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce3735ca-214e-4633-846c-0ffa6c7855e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045702 Aug 03 09:37:23.073004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 410/845] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:23.468716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:37:23.468973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:37:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:37:23.594699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:23.595253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:23.597323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:23.602820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.603322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.604114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.604546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.692485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:23.693121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:23.694935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:23.695587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=10 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:23.697148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:23.704486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.704958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.705736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.706170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.736649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3231c7faed9467e9dad37559ff342ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '733f2d7dcb854bba87efcf08912c40f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:23.744310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9ff39a31-ec04-47bb-8910-d2f1e3f2ee33 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 200 len: 1556 microversion: 2.1 time: 0.153621 Aug 03 09:37:23.744938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 436/846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:23 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:23.767174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:23.767656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:23.773603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.774049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.774890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:23.775318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:23.778919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:23.843419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:23.851006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2744b15d-999a-4c8e-a80d-81b58640539a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.162407 Aug 03 09:37:23.851576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 411/847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:23.859757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3167115-ca30-490a-b76f-b142a42c96e0 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096910 Aug 03 09:37:23.860362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 437/848] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 09:37:23 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:37:24.085154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:24.087298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:24.094244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:24.094686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:24.095433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:24.095860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:24.126755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c3fa92c4-55ac-4af4-ad3f-4a5c0cbd7fd3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045482 Aug 03 09:37:24.127510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 412/849] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:24.831159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-6c611a0c-01c0-49e8-97ad-73f96ac374fc req-5ca79619-2dbc-4ec7-ae06-a45aee0ae2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ac35a50-3b9f-41d8-8945-bebc20576b88", "tag": "7d2b7459-6442-4a92-b3a9-d4a50c96f1a1"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:37:24.840799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6c611a0c-01c0-49e8-97ad-73f96ac374fc req-5ca79619-2dbc-4ec7-ae06-a45aee0ae2d1 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:24.841268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-6c611a0c-01c0-49e8-97ad-73f96ac374fc req-5ca79619-2dbc-4ec7-ae06-a45aee0ae2d1 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:24.852835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-6c611a0c-01c0-49e8-97ad-73f96ac374fc req-5ca79619-2dbc-4ec7-ae06-a45aee0ae2d1 service nova] Creating event network-changed:7d2b7459-6442-4a92-b3a9-d4a50c96f1a1 for instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 on hv-cinder-84456 Aug 03 09:37:24.857703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-6c611a0c-01c0-49e8-97ad-73f96ac374fc req-5ca79619-2dbc-4ec7-ae06-a45aee0ae2d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089324 Aug 03 09:37:24.858938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 438/850] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:37:24.874773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:24.875398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:24.882916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:24.883360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:24.884127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:24.884562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:25.090290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:25.098231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce4371e3-f3b1-4c0e-93a4-6190185a6ce1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.228261 Aug 03 09:37:25.105280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 413/851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:25.140858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:25.143366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:25.149667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:25.150187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:25.151030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:25.151528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:25.182828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6154510c-854e-4706-9311-653d83b3dfc6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047440 Aug 03 09:37:25.188691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 439/852] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:26.120619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:26.121297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:26.127911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:26.128349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:26.129156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:26.129584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:26.196629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:26.199405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:26.206183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:26.206621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:26.207378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:26.207807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:26.241730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fd024b59-fd61-40ef-ae9f-b8d07b33a455 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049964 Aug 03 09:37:26.242292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 440/853] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:26.263692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:26.271473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-411da3eb-41ba-48b2-8986-813145116295 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154610 Aug 03 09:37:26.272036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 414/854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:27.254934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:27.257281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:27.264679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:27.265010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:27.266013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:27.266441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:27.294617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:27.295783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:27.299770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e5894b2-8861-49ae-8976-e81c9208e7bb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048813 Aug 03 09:37:27.300551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 441/855] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:27.308385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:27.308767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:27.309586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:27.310013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:27.474174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:27.483962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a9b87706-7a17-46c9-bf4e-b8d997ce0e8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.193820 Aug 03 09:37:27.484533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 415/856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:28.069930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:28.071253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:28.077475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.077929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.078696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.079325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.311697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:28.313754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:28.320244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.320686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.321472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.351390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-daa0a521-f87e-469c-bc55-4aad454b45ef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043769 Aug 03 09:37:28.351937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 416/857] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:28.504977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:28.505576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:28.511428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.511874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.512612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:28.513061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:28.644581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:28.652058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4e3abf89-9686-4710-8b45-665c6ec4bd33 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150778 Aug 03 09:37:28.652626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 417/858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:29.364056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:29.366262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:29.372643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:29.373115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:29.374530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:29.374962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:29.404332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a8af79d9-1489-4b0c-9493-1977723ccd1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Aug 03 09:37:29.404931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 418/859] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:29.674823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:29.675378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:29.681328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:29.681767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:29.682512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:29.682971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:29.698499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:29.813782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:29.821230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-06d672cf-95f0-4607-bb2b-c54b0c45ac36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150727 Aug 03 09:37:29.821785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 419/860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:30.415969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:30.418117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:30.424569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:30.425050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:30.425805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:30.426235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:30.455118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89403726-bf03-46b8-9849-9ba7c50486ee tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043165 Aug 03 09:37:30.455663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 420/861] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:30.843012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:30.843621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:30.849666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:30.850113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:30.850868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:30.851303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:30.985087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:30.992498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea5a01b3-903f-49a9-9362-20e6eaeabba3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154086 Aug 03 09:37:30.993093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 421/862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:31.467006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:31.469855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:31.476599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:31.477083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:31.477850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:31.478286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:31.507791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-64aedb68-3c96-4f38-a57f-5616debd2f82 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045068 Aug 03 09:37:31.508339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 422/863] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:32.014467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:32.015068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:32.021046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:32.021441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:32.022190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:32.022620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:32.153687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:32.161251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-303202e9-4bbd-4b6f-be0f-4826bf3201d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150626 Aug 03 09:37:32.161826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 423/864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:32.520435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:32.522628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:32.529085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:32.529538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:32.530888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:32.531321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:32.560225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0471a8d1-ac28-4d2a-a552-fc04caf96edb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043749 Aug 03 09:37:32.560787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 424/865] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:33.182906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:33.183506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:33.190276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:33.190717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:33.191467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:33.191891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:33.326185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:33.334062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02a6f61f-c3b4-466a-90d5-a059946bfc64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155128 Aug 03 09:37:33.334630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 425/866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:33.572736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:33.574939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:33.581371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:33.581809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:33.582552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:33.582980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:33.612863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83d623f9-92ab-4607-bc66-0c2bf41c4b67 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044060 Aug 03 09:37:33.613409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 426/867] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:34.355447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:34.356054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:34.362299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:34.362742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:34.363491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:34.363919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:34.492593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:34.500589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c025a572-784c-4efa-b4d9-9676776d2298 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148985 Aug 03 09:37:34.501194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 427/868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:34 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:34.625761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:34.627811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:34.634226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:34.634677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:34.635408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:34.635831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:34.664310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c505321-b83d-4898-a046-3ed2de331060 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043268 Aug 03 09:37:34.664866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 428/869] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:37:35.521452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:35.522067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:35.528120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:35.528564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:35.529335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:35.529768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:35.663726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:35.671841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fcfe373a-a3bd-4f65-908e-bbfb4811c4f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154227 Aug 03 09:37:35.672504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 429/870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:35.677179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:35.679279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:35.685063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:35.685508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:35.686264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:35.687297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:35.716192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b627f2c5-de00-43af-a5d7-caeeb915c6ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042615 Aug 03 09:37:35.716741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 430/871] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:36.693634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:36.694284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:36.700676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:36.701151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:36.701925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:36.703197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:36.836633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:36.844983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a5aa9ddc-abdd-4899-893e-14aaccc47207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155222 Aug 03 09:37:36.845547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 431/872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:36.850179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:36.852264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:36.857851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:36.858340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:36.859437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:36.859869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:36.888664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-99f9eb66-7ae8-4b03-a989-3c96fe34d068 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 Aug 03 09:37:36.889235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 432/873] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:37.865684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:37.866339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:37.872789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:37.873269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:37.874677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:37.875112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:38.003621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:38.011160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-663ca400-2c4c-42f1-ad33-13a187cf691b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149333 Aug 03 09:37:38.011730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 433/874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:38.016376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:38.018516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:38.024331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:38.025034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:38.025821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:38.026245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:38.055436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f27aaa45-ce36-4003-9f3e-1d41677be052 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042611 Aug 03 09:37:38.055919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 434/875] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:38.075482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=39 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:38.099043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=27 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:39.032836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:39.033381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:39.039747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:39.040187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:39.041010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:39.041439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:39.173864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:39.181248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0f62e528-bfb8-46b7-9fb3-cc1a75d926ff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152954 Aug 03 09:37:39.181807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 435/876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:39.186260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:39.188422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:39.193973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:39.194415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:39.195160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:39.195585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:39.199125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:39.225283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-56799398-584b-414f-ae1d-40534e159313 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042449 Aug 03 09:37:39.225830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 436/877] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:40.203359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:40.203951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:40.210458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:40.210905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:40.211670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:40.212102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:40.344575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:40.352059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b8d54566-3761-406d-89cd-3a80b664f240 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153262 Aug 03 09:37:40.352637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 437/878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:40.357127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:40.359272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:40.364909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:40.365354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:40.366106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:40.366536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:40.396068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a22791ad-aa1b-4417-9359-2f998a77fae1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042444 Aug 03 09:37:40.396606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 438/879] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:41.373619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:41.374346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:41.380697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:41.381251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:41.382003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:41.382430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:41.513928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:41.521976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7812ce9e-c610-4b84-a1a0-bae299e88ce3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152210 Aug 03 09:37:41.522666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 439/880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:41.527225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:41.529402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:41.535617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:41.536066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:41.536844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:41.537284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:41.565953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10a53c46-9d16-42ee-beb1-fa0dd305996a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042265 Aug 03 09:37:41.566503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 440/881] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:42.543409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:42.544071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:42.551116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:42.551557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:42.552302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:42.552725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:42.682841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:42.690560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e68d5740-f4be-4be6-927f-cb35ffe589ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151000 Aug 03 09:37:42.691117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 441/882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:42.695608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:42.697718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:42.703303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:42.703749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:42.704525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:42.704964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:42.734251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-20cb6c64-173b-4c9a-87e6-b307a652562f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041601 Aug 03 09:37:42.735005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 442/883] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:43.712033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:43.712746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:43.719546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:43.719986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:43.720732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:43.721185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:43.853253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:43.861611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8d533afe-7f2c-43de-af26-f02abb674f03 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153444 Aug 03 09:37:43.862174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 443/884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:43.866683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:43.868777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:43.875893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:43.876332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:43.877105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:43.877538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:43.905187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-35c02759-1bfa-4d0f-a2c0-032d30d660c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042008 Aug 03 09:37:43.905773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 444/885] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:44.883101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:44.883714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:44.890811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:44.891261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:44.892015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:44.892446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:45.023984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:45.031479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fba09d30-0ebe-455b-af51-869c52336088 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152237 Aug 03 09:37:45.032100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 445/886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:44 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:45.036603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:45.038724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:45.044311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:45.044760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:45.045546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:45.045983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:45.075345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5e4c592-d968-4694-a681-f96ced84facb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042284 Aug 03 09:37:45.075896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 446/887] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:46.052725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:46.053377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:46.059898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:46.060344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:46.061130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:46.061561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:46.191215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:46.198585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89a16b72-32e8-4b6d-a76a-84df430bbe53 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149751 Aug 03 09:37:46.199143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 447/888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:46.204418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:46.206499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:46.212027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:46.212462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:46.213241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:46.213670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:46.243859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cacd2751-a5e9-463e-8f6e-d7839a5f2205 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043712 Aug 03 09:37:46.244404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 448/889] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:47.220685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:47.221343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:47.227782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:47.228233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:47.229022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:47.229461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:47.360624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:47.368193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9073a376-6bb2-474d-b362-b3ce0256799c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151465 Aug 03 09:37:47.368746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 449/890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:47.373211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:47.375935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:47.381488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:47.381927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:47.382670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:47.383096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:47.412238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e8ce407-96c2-4d00-ab10-0e9b4d21b051 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042464 Aug 03 09:37:47.412784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 450/891] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:48.390769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:48.391555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:48.397832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:48.398279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:48.399030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:48.399458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:48.530687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:48.538869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1031ea84-c141-4f15-9068-8a4ded1b22eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152550 Aug 03 09:37:48.539431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 451/892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:48.543978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:48.546085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:48.551732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:48.552174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:48.552960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:48.553392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:48.578615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:48.583475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d294c203-b77f-4715-b8b0-a333eb613fae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043096 Aug 03 09:37:48.584024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 452/893] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:49.560617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:49.561295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:49.567918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:49.568366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:49.569152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:49.569585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:49.697783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:49.705978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83c6f06f-59f7-4b24-80e7-c35e8dfb6a70 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149525 Aug 03 09:37:49.706541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 453/894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:49.711034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:49.713138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:49.719951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:49.720276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:49.721051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:49.721483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:49.750563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b7784d3-2e85-41f0-b7dc-e88ab7d3ab0d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042812 Aug 03 09:37:49.751124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 454/895] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:50.728517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:50.729318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:50.736010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:50.736458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:50.737257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:50.737691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:50.873228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:50.881425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c868406-a332-4648-8280-3d31944d5523 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156695 Aug 03 09:37:50.881995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 455/896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:50.886689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:50.888790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:50.895071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:50.895519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:50.896280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:50.896712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:50.924837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c69ff4d3-7353-4d82-a41f-eb5b30d1a708 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041839 Aug 03 09:37:50.925386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 456/897] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:51.903574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:51.904291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:51.911686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:51.912130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:51.912914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:51.913347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:52.044019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:52.054261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9fe2597b-ccaf-43c0-a613-178fa25125de tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154479 Aug 03 09:37:52.055012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 457/898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:52.059816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:52.061958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:52.068365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:52.068820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:52.069599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:52.070028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:52.103397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-56578f54-3bd7-4e96-8a0f-16a09f764c14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047237 Aug 03 09:37:52.103952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 458/899] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:53.075567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:53.076214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:53.082909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:53.083348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:53.084101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:53.084533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:53.215388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:53.223449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3d4d89d9-0ddb-4d70-985c-ead2ab2c5dc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.151836 Aug 03 09:37:53.224019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 459/900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:53.228552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:53.230676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:53.237156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:53.237612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:53.238247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:53.238678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:53.267753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-412c4861-a9b2-4d98-9dbb-05c359aa4f3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042691 Aug 03 09:37:53.268300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 460/901] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:54.245322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:54.245958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:54.248251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:54.254413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:54.254862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:54.255630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:54.256067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:54.384970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:54.392459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-66fcc26f-ee5e-444c-b4b4-4244a383527b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150931 Aug 03 09:37:54.393061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 461/902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:54.397508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:54.399581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:54.405169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:54.405611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:54.406350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:54.406774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:54.435682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea3ddf70-61a1-4b4c-ab3c-3651b67fa950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041629 Aug 03 09:37:54.436228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 462/903] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:55.413217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:55.413866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:55.420304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:55.420743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:55.421523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:55.421950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:55.554947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:55.563006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-14b22d9c-6a12-47c5-a866-f3fb9c311a29 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153619 Aug 03 09:37:55.563588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 463/904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:55.568661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:55.570772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:55.576498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:55.576990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:55.577751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:55.578185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:55.607343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4a4b4fd-2fff-47d1-94fb-b92b8b3f336b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042253 Aug 03 09:37:55.607888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 464/905] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:56.585576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:56.586238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:56.592862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:56.593304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:56.594068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:56.594495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:56.732271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:56.739749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3cf605ca-c4a7-41c0-a4a6-ede6bbe31a4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.157973 Aug 03 09:37:56.740300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 465/906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:37:56.744955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:56.746867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:56.752477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:56.752954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:56.753704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:56.754130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:56.783945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-373dbd45-c150-455b-95c4-e0401e3d8061 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042666 Aug 03 09:37:56.784480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 466/907] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:57.761538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:57.762209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:57.768767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:57.769243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:57.770004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:57.770441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:57.899725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:57.907221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b8dd6d26-5d86-4094-ace4-325d126b15f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149679 Aug 03 09:37:57.907795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 467/908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:57.913068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:57.915168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:57.920838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:57.921306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:57.922069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:57.922504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:57.951787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de81c2a5-524f-4b32-9fd3-ba587b82a2f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043015 Aug 03 09:37:57.952330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 468/909] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:58.929778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:58.930427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:58.936922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:58.937369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:58.938133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:58.938569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:58.953868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:37:59.075246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:37:59.082829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b16a71ae-31fa-4e61-9831-d0700dcf57a5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156869 Aug 03 09:37:59.083391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 469/910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:37:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:37:59.088026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:37:59.090434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:37:59.096079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:59.096529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:59.097849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:37:59.098307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:37:59.133248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-37e8dbf4-cde6-4b50-89d8-2174e53008c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048629 Aug 03 09:37:59.134061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 470/911] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:37:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:37:59.219178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:38:00.104834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:00.105452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:00.111894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.112489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.113925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.114364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.241737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:00.249286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb369763-13d4-4ca5-b97e-fc57f6806908 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148265 Aug 03 09:38:00.249859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 471/912] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:00.254539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:00.256620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:00.262319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.262758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.263505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.263929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.293657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb232733-ec06-40ae-b5c7-9424fb39aa97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042794 Aug 03 09:38:00.294202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 472/913] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:00.773371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:00.773865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:00.779888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.780334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.781126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:00.781562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:00.804490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96921b5a-7ee3-4845-a97e-ccad8273fc34 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88/ips" status: 200 len: 149 microversion: 2.1 time: 0.035810 Aug 03 09:38:00.805089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 473/914] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 09:38:00 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:38:01.271664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:01.272306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:01.278865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:01.279316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:01.280075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:01.280511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:01.416708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:01.424124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67c61876-48e4-4bb8-b319-483124bca96c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.157277 Aug 03 09:38:01.424681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 474/915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:01.429750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:01.431865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:01.437449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:01.437890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:01.438639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:01.439081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:01.468397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c739e65e-fc66-4982-a4cf-225183439e68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042114 Aug 03 09:38:01.468947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 475/916] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:02.446012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:02.446672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:02.453349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:02.453793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:02.454583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:02.455019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:02.585137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:02.592806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a19967f1-2041-458d-b585-8836555d3d6b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150671 Aug 03 09:38:02.593387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 476/917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:02.599460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:02.601636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:02.607818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:02.608315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:02.609140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:02.609593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:02.639835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f5c04dc9-9b74-4e27-9872-0cb61f7979a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044647 Aug 03 09:38:02.640394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 477/918] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:03.615499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:03.616176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:03.622638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:03.623082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:03.623831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:03.624259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:03.754429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:03.761870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e5d3afc-d55a-4d9b-b17b-c8f667a621f0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150817 Aug 03 09:38:03.762460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 478/919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:03.766920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:03.769071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:03.774720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:03.775142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:03.775893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:03.776314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:03.805495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-db6f9766-5ddf-4042-b575-44dff43cfc4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042062 Aug 03 09:38:03.806033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 479/920] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:04.784278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:04.784932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:04.791417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:04.792219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:04.792615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:04.793074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:04.924502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:04.932321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-da0e7bf8-7736-429a-af7c-60744eeb5434 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152117 Aug 03 09:38:04.932915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 480/921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:04.937552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:04.939654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:04.945551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:04.945999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:04.946764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:04.947198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:04.976920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-262efa1d-1ac8-4418-9f08-022a1b58d1f1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042986 Aug 03 09:38:04.977464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 481/922] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:05.953846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:05.954504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:05.961388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:05.961839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:05.962596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:05.963028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:06.094210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:06.102419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1df19f95-c5e3-46bf-aabc-fb3acf2641e2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152462 Aug 03 09:38:06.102982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 482/923] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:06.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:06.109531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:06.116242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:06.116687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:06.117567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:06.118000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:06.146719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a5c9e5f-9224-4747-a6bb-f79a5d2b7bfe tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042754 Aug 03 09:38:06.147262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 483/924] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:07.124661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:07.125300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:07.132510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:07.132982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:07.133727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:07.134154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:07.265856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:07.273484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f7cdddd-afd6-4cb1-a3b5-ba9fa092376b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152652 Aug 03 09:38:07.274054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 484/925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:07.278664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:07.280771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:07.287333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:07.287778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:07.288526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:07.288988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:07.317503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dbb80240-8261-4fe0-902e-45ad43c9eb46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042397 Aug 03 09:38:07.317985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 485/926] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:08.295443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:08.296085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:08.302874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:08.303319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:08.304076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:08.304509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:08.319948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:08.435913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:08.444011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b84293c3-d23e-4031-964d-d73c41aa724d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152608 Aug 03 09:38:08.444575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 486/927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:08.449125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:08.451209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:08.457796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:08.458291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:08.459056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:08.459552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:08.489106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b4e08da-df35-4bb7-bd41-1a480067fb7d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042946 Aug 03 09:38:08.489804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 487/928] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:09.224462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:09.465574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:09.466491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:09.473954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:09.474419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:09.475176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:09.475604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:09.608198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:09.615741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c7e2fa7a-98da-4e25-aae3-7aed80c83e71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154019 Aug 03 09:38:09.616317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 488/929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:09.620837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:09.622960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:09.628553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:09.629630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:09.630399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:09.630830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:09.659279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-88b82112-1896-4c79-ab7e-948445e79a1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041948 Aug 03 09:38:09.659832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 489/930] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:10.637333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:10.637971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:10.644448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:10.645631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:10.646530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:10.646968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:10.776912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:10.784378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e054bbe5-329b-4eb5-82df-f58b46231c6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150878 Aug 03 09:38:10.784971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 490/931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:10.790586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:10.792676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:10.798571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:10.799055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:10.799821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:10.800256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:10.828930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c798d26b-572c-430b-a5ef-9db742fc058a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041967 Aug 03 09:38:10.829481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 491/932] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:11.807116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:11.807786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:11.814175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:11.814617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:11.815369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:11.815800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:11.943838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:11.951266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-86e5ee56-31d6-4bff-af41-5eb4859ff234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148091 Aug 03 09:38:11.951829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 492/933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:11.956392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:11.958609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:11.964134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:11.964575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:11.965368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:11.966065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:11.995102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c9f6cd0b-fe5b-44e6-b3b5-ebeee5141c56 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042276 Aug 03 09:38:11.995647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 493/934] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:12.973081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:12.973730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:12.980400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:12.980865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:12.981618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:12.982043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:13.115577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:13.122955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9bfd1a0d-70e4-47c9-8dd8-7ae71a61f97a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153786 Aug 03 09:38:13.123511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 494/935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:13.127945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:13.130801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:13.136336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:13.136774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:13.137554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:13.137981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:13.165986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f33551bb-793c-4424-a1d0-5de67d452431 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041504 Aug 03 09:38:13.166525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 495/936] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:14.146075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:14.146782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:14.152746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:14.153240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:14.153988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:14.154414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:14.282308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:14.290258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-52f6c5fd-6ec9-4b13-a668-084b5ba99c42 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148784 Aug 03 09:38:14.290816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 496/937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:14.295297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:14.297413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:14.303608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:14.304146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:14.305034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:14.305413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:14.336146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5efea76a-5851-4563-8249-06b963ea4bd9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044330 Aug 03 09:38:14.336686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 497/938] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:15.311529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:15.312127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:15.318842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:15.319280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:15.320031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:15.320458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:15.452130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:15.460106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1a1f2952-7bcf-4532-b131-960ed2d9fb18 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152501 Aug 03 09:38:15.460670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 498/939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:15.465475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:15.467781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:15.474019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:15.474572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:15.475347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:15.475776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:15.503538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02d8b558-26d3-4a90-81cf-c72e85d31c31 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041880 Aug 03 09:38:15.504635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 499/940] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:16.481974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:16.482609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:16.489729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:16.490168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:16.490917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:16.491346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:16.618773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:16.626139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-890c626b-020b-439c-b347-11760cfc8a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148006 Aug 03 09:38:16.626721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 500/941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:16.631938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:16.634046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:16.639594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:16.640041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:16.640785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:16.641238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:16.670086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d8575c3f-8606-4377-aef5-362f9214b3c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042363 Aug 03 09:38:16.670647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 501/942] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:17.648670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:17.649365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:17.655678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:17.656115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:17.656887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:17.657316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:17.785096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:17.792555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41a8a6dd-05ad-4ca8-849a-620a275424c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148230 Aug 03 09:38:17.793200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 502/943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:17.797764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:17.799844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:17.805808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:17.806251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:17.807002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:17.807438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:17.811055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:17.837110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc683cd6-3c1f-4d14-8b38-d4c5202fdcc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042891 Aug 03 09:38:17.837652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 503/944] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:18.814383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:18.814994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:18.822094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:18.822532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:18.823277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:18.823703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:18.958984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:18.967306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-37e3cf54-ade1-45a8-8730-8cdbf908839a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.156702 Aug 03 09:38:18.967894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 504/945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:18.972687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:18.975143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:18.981613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:18.982062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:18.982845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:18.983280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:19.015057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4457856c-93a4-475b-9d26-6921c47c76ff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046109 Aug 03 09:38:19.015615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 505/946] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:19.988774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:19.989459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:19.995982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:19.996423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:19.997201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:19.997631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:20.129916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:20.137710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f0bfedf-d56a-4f5c-8376-e336126b6c7a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152733 Aug 03 09:38:20.138281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 506/947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:20.142835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:20.144949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:20.150894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:20.151339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:20.152087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:20.152515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:20.182114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-05e9003e-8854-487e-a10f-870b5db3f460 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042773 Aug 03 09:38:20.182589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 507/948] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:21.161677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:21.162406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:21.168800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:21.169294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:21.170052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:21.170492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:21.311878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:21.320059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-31692a86-c18e-4bea-8bc0-ba02458e3733 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.162291 Aug 03 09:38:21.320618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 508/949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:21.325122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:21.327191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:21.332738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:21.333239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:21.334178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:21.334617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:21.362769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1324b0c2-c9a7-4fd6-9cd3-6534504a35fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041151 Aug 03 09:38:21.363307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 509/950] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:22.341314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:22.342197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:22.348543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:22.349571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:22.350315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:22.350742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:22.479550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:22.487179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04baa3db-62f0-48eb-a201-34cb57f403fa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149776 Aug 03 09:38:22.487746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 510/951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:22.493022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:22.495133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:22.496974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:22.502184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:22.502630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:22.503387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:22.503822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:22.533188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7dbbf1a0-e209-49b6-9da2-d351581777d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044438 Aug 03 09:38:22.533884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 511/952] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:23.510621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:23.511326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:23.517847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:23.518293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:23.519047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:23.519503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:23.655008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:23.662470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62bd1350-9f47-4458-a41a-67edf363a839 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155912 Aug 03 09:38:23.663029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 512/953] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:23.667748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:23.669852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:23.675388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:23.675830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:23.676572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:23.677566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:23.706842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-983d9fc0-30db-40dd-af5a-066432fccc3e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042803 Aug 03 09:38:23.707392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 513/954] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:24.683645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:24.684246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:24.690855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:24.691301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:24.692049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:24.692479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:24.824708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:24.832357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b863129b-d5fd-4c1d-aa4e-f184bfd64b4d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152561 Aug 03 09:38:24.832877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 514/955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:24.838293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:24.840408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:24.846285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:24.846733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:24.847493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:24.847929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:24.876730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee9994c4-ca28-40a7-ad4d-327735741021 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042198 Aug 03 09:38:24.877419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 515/956] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:25.854446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:25.855132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:25.861527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:25.861973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:25.862725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:25.863158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:25.993992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:26.001376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0b4e15d-3398-4706-9540-947dda545178 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150855 Aug 03 09:38:26.001926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 516/957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:26.007971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:26.010088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:26.015782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:26.016220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:26.017001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:26.017430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:26.046952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2b1dc4d9-340e-49a8-83e7-8d4904b2744a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044048 Aug 03 09:38:26.047491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 517/958] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:27.023078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:27.023743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:27.030254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:27.030698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:27.031455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:27.031890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:27.379022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:38:27.386747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-85d959ed-6831-418d-99ca-61fef03e7f31 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.367887 Aug 03 09:38:27.387311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 518/959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:38:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:38:27.391920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:27.394025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:27.400379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:27.400846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:27.401604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:27.402034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:27.426557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:27.431528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e9172647-af12-49a3-b2e1-459afb6a204c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043265 Aug 03 09:38:27.432081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 519/960] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:38:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:38:28.132848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:38:28.133549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:38:28.142908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:28.143350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:28.144108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:38:28.144533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:38:38.138876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=19 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:38:38.165016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=5 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:39:28.208518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5690eb9d-f4cc-4cee-8ed3-994f1734c79c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 202 len: 0 microversion: 2.1 time: 120.142319 Aug 03 09:39:28.209205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 442/961] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:37:28 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 0 bytes in 120144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:39:28.214765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:28.215467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:28.223974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.224137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.224791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.225243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.366432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:39:28.374631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dbec89b3-bc7e-48ab-a549-300d717d94ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.164308 Aug 03 09:39:28.375189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 443/962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:39:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:39:28.380015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:28.382320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:28.388725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.389387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.390542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.390958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.420184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ee512b9-0b99-4a7b-b9cc-0432949055f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043702 Aug 03 09:39:28.420748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 444/963] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:39:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:39:28.425129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:28.425614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:28.431223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.431667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.432442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.432886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.458373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:39:28.534902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3b93544-e8ed-4512-83e9-a3a015b9db50 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 204 len: 0 microversion: 2.1 time: 0.112586 Aug 03 09:39:28.538313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 445/964] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:39:28 2022] DELETE /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:39:28.540525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:28.541173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:28.547391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.547829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.548677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:28.549143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:28.653173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:39:38.545173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:39:38.568563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:39:38.657994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:39:59.360681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:39:59.389974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:39:59.393537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:39:59.395000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:39:59.395645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:39:59.396787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.398100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:39:59.399247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) Aug 03 09:39:59.400414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.405372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8a9f425d-67c5-46ee-985c-2215abfb24d3) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:39:59.405372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f024350-b5ef-4294-be08-c435364afa94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 91.267590 Aug 03 09:39:59.405372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 520/965] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:38:28 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 91271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 09:39:59.405372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:59.406023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:59.413881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.414486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.415486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.415966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.431836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 HTTP/1.1 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:39:59.433366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:39:59.434800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9ac35a50-3b9f-41d8-8945-bebc20576b88'} Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:39:59.435816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:39:59.437762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:39:59.441657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:39:59.441657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ca7970b1-f2dc-4b44-9ba3-5a652f651431 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 404 len: 111 microversion: 2.1 time: 0.036381 Aug 03 09:39:59.441657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 521/966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:39:59 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:39:59.441657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:59.442753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:59.448970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.449329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.450077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.450546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.587382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:39:59.595822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6e230001-28a0-4b88-afdf-ad7ac3cbc2aa tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.159054 Aug 03 09:39:59.596398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 522/967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:39:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:39:59.601330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:59.603505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:39:59.609202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.609649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.611275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.611688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.639868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb430125-f6ac-40c4-ad1e-66617398625a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042415 Aug 03 09:39:59.640410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 523/968] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:39:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:39:59.644959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-556541d1-9af1-4f52-898d-c8e9dbe39b47 req-75f03f5c-f703-4f36-93d9-b16280e2b177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ac35a50-3b9f-41d8-8945-bebc20576b88", "name": "network-vif-deleted", "tag": "7d2b7459-6442-4a92-b3a9-d4a50c96f1a1"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:39:59.653797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-556541d1-9af1-4f52-898d-c8e9dbe39b47 req-75f03f5c-f703-4f36-93d9-b16280e2b177 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:39:59.654237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-556541d1-9af1-4f52-898d-c8e9dbe39b47 req-75f03f5c-f703-4f36-93d9-b16280e2b177 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:39:59.665328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-556541d1-9af1-4f52-898d-c8e9dbe39b47 req-75f03f5c-f703-4f36-93d9-b16280e2b177 service nova] Creating event network-vif-deleted:7d2b7459-6442-4a92-b3a9-d4a50c96f1a1 for instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 on hv-cinder-84456 Aug 03 09:39:59.670253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-556541d1-9af1-4f52-898d-c8e9dbe39b47 req-75f03f5c-f703-4f36-93d9-b16280e2b177 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028667 Aug 03 09:39:59.670807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 524/969] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:39:59.676195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b7e509e-db98-4a77-acd3-793b1e0a63bd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '.version_select at 0x7fb99d5005e0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:39:59.694873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b7e509e-db98-4a77-acd3-793b1e0a63bd tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-461593132" status: 202 len: 0 microversion: 2.1 time: 0.022898 Aug 03 09:39:59.695424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 525/970] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 3 09:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-461593132 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:40:00.307891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.308537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.315779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.316229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.317024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.317461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.330484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 HTTP/1.1 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.332104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.333717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9ac35a50-3b9f-41d8-8945-bebc20576b88'} Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.334581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.335772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.336996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.336996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81fbf055-1032-413a-b366-fa833ebe7de6 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 404 len: 111 microversion: 2.1 time: 0.030054 Aug 03 09:40:00.336996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 526/971] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:40:00 2022] DELETE /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:40:00.341390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.341998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9ac35a50-3b9f-41d8-8945-bebc20576b88] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.348398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.348872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.349630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.350072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.363609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 HTTP/1.1 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.365111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.366637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9ac35a50-3b9f-41d8-8945-bebc20576b88'} Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.367463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. Aug 03 09:40:00.368942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.370191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9ac35a50-3b9f-41d8-8945-bebc20576b88 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.370191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b4647038-acf8-476e-a615-939f72440440 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88" status: 404 len: 111 microversion: 2.1 time: 0.028569 Aug 03 09:40:00.370191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 527/972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:00 2022] GET /compute/v2.1/servers/9ac35a50-3b9f-41d8-8945-bebc20576b88 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:40:00.374138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.374590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.380242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.380687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.381476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.381912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.395466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 HTTP/1.1 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.397021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.398588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9481377c-68db-499c-a657-afe14aabd667'} Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.399433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.400940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.402546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.402546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e137636e-47f5-4470-86b3-a15f575e169d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 404 len: 111 microversion: 2.1 time: 0.027653 Aug 03 09:40:00.402546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 528/973] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:40:00 2022] DELETE /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:40:00.406178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.407280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 9481377c-68db-499c-a657-afe14aabd667] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.413257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.413709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.414474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.414905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.428966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 HTTP/1.1 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.430479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.432563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9481377c-68db-499c-a657-afe14aabd667'} Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.433726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. Aug 03 09:40:00.435311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.436603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 9481377c-68db-499c-a657-afe14aabd667 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.436603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2d6b5aa4-6bba-4349-8a8d-d3209d133dcb tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667" status: 404 len: 111 microversion: 2.1 time: 0.029093 Aug 03 09:40:00.436603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 529/974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:00 2022] GET /compute/v2.1/servers/9481377c-68db-499c-a657-afe14aabd667 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:40:00.439806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.440288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.445863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.446254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.447002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.447434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.461622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c HTTP/1.1 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.463152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.464700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '31118185-b7f0-486e-a7d9-6d518fb07d3c'} Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.465537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.466730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.467931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.467931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e47e2eb0-d9c0-48b3-b44a-bb3bb42a566d tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 404 len: 111 microversion: 2.1 time: 0.028474 Aug 03 09:40:00.467931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 530/975] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:40:00 2022] DELETE /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 09:40:00.473383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.473983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: 31118185-b7f0-486e-a7d9-6d518fb07d3c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.479543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.479986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.480736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.481207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.494852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c HTTP/1.1 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:40:00.496333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '31118185-b7f0-486e-a7d9-6d518fb07d3c'} Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:40:00.498886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. Aug 03 09:40:00.500424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:40:00.501975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance 31118185-b7f0-486e-a7d9-6d518fb07d3c could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:40:00.501975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a6c3bc6-576c-486a-a08b-7bd1b4cef677 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c" status: 404 len: 111 microversion: 2.1 time: 0.029035 Aug 03 09:40:00.501975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 531/976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:00 2022] GET /compute/v2.1/servers/31118185-b7f0-486e-a7d9-6d518fb07d3c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:40:00.617788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.618390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.624307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.624748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.625520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.625947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.764020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:00.772200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-43856aa8-78a3-445b-b313-b756fadc74a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158193 Aug 03 09:40:00.772759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 532/977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:40:00.777747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:00.779832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:00.786188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.786635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.787389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:00.787823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:00.815900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-14daf58c-72b3-47d9-bcdf-7f7fafb3c506 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041698 Aug 03 09:40:00.816453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 533/978] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:01.794306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:01.794977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:01.802407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:01.802851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:01.803606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:01.804038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:01.935834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:01.943653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04bedcb6-7dda-43bd-9372-cdc0e21fdc5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153190 Aug 03 09:40:01.944220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 534/979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:01.948752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:01.950884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:01.956650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:01.957130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:01.957899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:01.958332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:01.992789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6bdcae86-95f1-4d0c-b280-d2d96606140e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047551 Aug 03 09:40:01.993364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 535/980] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:02.965719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:02.966363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:02.972902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:02.973644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:02.974403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:02.974866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:03.107760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:03.115814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd8554a3-ff5e-42dd-95d6-28b1c16e13eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153942 Aug 03 09:40:03.116374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 536/981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:03.121114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:03.123220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:03.129750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:03.130202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:03.130987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:03.131416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:03.159928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-85ed7213-1724-43c3-b5f2-7afa6b2ee570 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042528 Aug 03 09:40:03.160476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 537/982] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:04.138211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:04.138857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:04.145911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:04.146355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:04.147103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:04.147532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:04.279436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:04.287270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b292207-dd3e-4725-88e8-5c89465d823c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152894 Aug 03 09:40:04.287832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 538/983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:04.292301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:04.294412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:04.300523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:04.301027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:04.301806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:04.302232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:04.332137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3399343-ce32-47b8-b8c0-76c3623d45e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043241 Aug 03 09:40:04.332619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 539/984] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:05.308862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:05.309504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:05.316234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:05.316675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:05.317532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:05.317966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:05.450117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:05.458167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb01e049-1387-493e-a8d2-bc627008391e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153263 Aug 03 09:40:05.458735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 540/985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:05.463310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:05.465421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:05.471642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:05.472089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:05.472870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:05.473551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:05.502313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-916c72eb-4a3f-45d0-a362-76951e766520 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042107 Aug 03 09:40:05.502862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 541/986] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:06.479545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:06.480194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:06.488832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:06.489282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:06.490047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:06.490472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:06.627966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:06.635435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c5213ca1-fdc3-44d7-a974-a515690015e5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.159806 Aug 03 09:40:06.635997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 542/987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:06.641591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:06.644639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:06.650298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:06.650741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:06.651487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:06.651915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:06.678242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:06.683088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb93bdc6-2c24-4b9d-9fc3-9c1ae9a88d18 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046154 Aug 03 09:40:06.683628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 543/988] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:07.657313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:07.658130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:07.664624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:07.665090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:07.665840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:07.666268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:07.795353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:07.803390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-21a874c7-fabb-498f-8102-72548b61a1b7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150265 Aug 03 09:40:07.803943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 544/989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:07.808363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:07.810449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:07.816138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:07.816576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:07.817343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:07.817769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:07.848012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2df8f25-c188-480f-9a8c-c3c5bc6a1bad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043043 Aug 03 09:40:07.848833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 545/990] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:08.824800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:08.825468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:08.832618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:08.833085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:08.833841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:08.834301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:08.971977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:08.979702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41456d1f-e686-40b5-9b55-0bde76560a2d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.158783 Aug 03 09:40:08.980265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 546/991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:08.986327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:08.989272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:08.996589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:08.997145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:08.997906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:08.998334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:09.026972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-280477a5-5187-4525-b20e-2e0e8dcc9999 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045720 Aug 03 09:40:09.027510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 547/992] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:09.364476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:10.001169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:10.002357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:10.008946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:10.009400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:10.010162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:10.010597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:10.139940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:10.147986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4e7b3332-0128-405c-8749-d9369ddf9234 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150694 Aug 03 09:40:10.148545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 548/993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:10.153059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:10.155158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:10.161743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:10.162216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:10.162995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:10.163422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:10.192853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-65361aca-d02f-437f-90ab-0ce37702280f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043284 Aug 03 09:40:10.193392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 549/994] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:11.170022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:11.170618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:11.178036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:11.178477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:11.179223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:11.179654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:11.320884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:11.328372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8ef39ef2-2ea3-4bd1-9493-851df41525b6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.162250 Aug 03 09:40:11.328950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 550/995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:11.333917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:11.336242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:11.342125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:11.342666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:11.343634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:11.344062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:11.373851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-813fe1ef-1941-43f6-9201-ebdf2bd02a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 Aug 03 09:40:11.374396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 551/996] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:12.350745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:12.351385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:12.357809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:12.358253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:12.359004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:12.359435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:12.489263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:12.496748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9008de27-c257-4c5a-b6af-b5584f2cd552 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.150143 Aug 03 09:40:12.497346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 552/997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:40:12.502444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:12.504629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:12.510268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:12.510714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:12.511481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:12.511913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:12.541093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f9035aac-e15a-4fd7-8d4c-b898fb2d0f7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042734 Aug 03 09:40:12.541644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 553/998] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:13.519014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:13.519689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:13.526079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:13.526529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:13.527277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:13.527699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:13.655471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:13.663478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ab5a514e-3216-4143-b039-be21ef2ba8a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148888 Aug 03 09:40:13.664037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 554/999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:13.668479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:13.670596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:13.676432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:13.676900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:13.677658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:13.678109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:13.706710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f108f45-6015-4c02-8e04-034a349551e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041706 Aug 03 09:40:13.707246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 555/1000] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:14.685049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:14.685724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:14.691883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:14.692329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:14.693186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:14.693619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:14.826519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:14.834445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c870410-8b9a-45dc-a4f1-18bab256403a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.153286 Aug 03 09:40:14.834990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 556/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:14.839753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:14.841881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:14.848648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:14.849384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:14.850143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:14.850578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:14.880260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9ad0bcd7-8700-410c-86d5-498c7022fc7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Aug 03 09:40:14.880804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 557/1002] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:15.855880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:15.856540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:15.863775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:15.864213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:15.865006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:15.865442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:15.996534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:16.005006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81c67619-3e81-4f1c-9331-03e8970452f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.152940 Aug 03 09:40:16.005568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 558/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:16.010180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:16.012270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:16.018131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:16.018583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:16.019345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:16.019778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:16.049392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02b76acb-c789-488c-8250-035f4341e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042115 Aug 03 09:40:16.050122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 559/1004] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:17.026401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:17.027035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:17.033520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:17.033972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:17.034718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:17.035144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:17.052727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:17.169503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:17.177605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f83e9f85-9d5b-477e-9d7a-1036bed05077 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155035 Aug 03 09:40:17.178170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 560/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:17.182698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:17.184774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:17.191087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:17.191528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:17.192273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:17.192700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:17.222067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3dd3f2d-c685-4852-a105-06c17b75f334 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042888 Aug 03 09:40:17.222621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 561/1006] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:18.199417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:18.200059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:18.207153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:18.207593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:18.208337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:18.208764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:18.483268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:18.491402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b5a9a39c-7798-4cec-b4a2-d45ff1e14c83 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.295864 Aug 03 09:40:18.491953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 562/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:18.496373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:18.498461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:18.504627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:18.505191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:18.505931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:18.506359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:18.534618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e5df4c2-8367-4163-b9cb-bee19b0d4f62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041609 Aug 03 09:40:18.535144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 563/1008] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:19.512953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:19.513639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:19.519969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:19.520407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:19.521173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:19.521599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:19.649810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:19.657391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b43ec49a-e0a8-4391-a311-328ca252250c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.148294 Aug 03 09:40:19.657950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 564/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:19.662825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:19.664935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:19.670735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:19.671189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:19.671947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:19.672381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:19.701850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5f1f743-de85-4227-8a2a-d047a07966c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042759 Aug 03 09:40:19.702388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 565/1010] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:20.678679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:20.679313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:20.685862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:20.686312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:20.687063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:20.687494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:20.821852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:20.829381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f366d67-4326-459e-9f62-c4ed7954572b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.154614 Aug 03 09:40:20.829937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 566/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:20.835488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:20.837596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:20.843384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:20.843834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:20.844598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:20.845060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:20.874897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-705762f9-35c8-4013-9120-34ffc548a840 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 Aug 03 09:40:20.875549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 567/1012] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:21.853182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:21.853850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:21.860385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:21.860870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:21.861783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:21.862219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:21.991005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:21.998446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b3bfb08-b828-49dd-b617-245e55f6f4cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.149422 Aug 03 09:40:21.999012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 568/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:22.004159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:22.006270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:22.008927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:22.012702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:22.013186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:22.013943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:22.014377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:22.043755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e86018c5-5653-4104-8d92-e24661f35ba5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043756 Aug 03 09:40:22.044290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 569/1014] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:23.020423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:23.021080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:23.027492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:23.027934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:23.028680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:23.029141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:23.164789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:23.172231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ed568b88-1ad0-4727-9d80-5bc4c420e122 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155828 Aug 03 09:40:23.172783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 570/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:23.177453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:23.179522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:23.185156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:23.185592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:23.186331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:23.186751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:23.215214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-09c422bc-9887-4193-84a2-1b80e423cad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041412 Aug 03 09:40:23.215746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 571/1016] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:24.196764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:24.201450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:24.207970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:24.208410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:24.209187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:24.209613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:24.339560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:24.348023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ba5144f-537e-4e18-86c5-cd0f69df01b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.155158 Aug 03 09:40:24.348588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 572/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:40:24.353419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:24.355505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:24.361091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:24.362605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:24.363376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:24.363813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:24.392019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dec3c62b-1810-4ca2-8c33-b6436628fd97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042432 Aug 03 09:40:24.392552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 573/1018] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:25.370419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:25.371063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:25.378265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:25.378702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:25.379447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:25.379874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:25.519330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:25.526731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f94ed6c-2412-4bdb-bf19-fcc5b86c649e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.160225 Aug 03 09:40:25.527292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 574/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:25.531780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:25.534041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:25.539618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:25.540072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:25.540828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:25.541481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:25.570852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-727a0d42-2c1c-4d66-ba4e-e752a6916aa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042515 Aug 03 09:40:25.571411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 575/1020] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:26.548579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:26.549370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:26.555738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:26.556180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:26.556954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:26.557381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:26.758889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:26.766342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a6663ac-3d03-459a-90a0-0eb14e167fd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.221713 Aug 03 09:40:26.766899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 576/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:26.771992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:26.774119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:26.779707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:26.780147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:26.780921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:26.781353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:26.785660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:26.812176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc1bdc9a-7faa-4423-8d6c-5bb5a486a20c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044227 Aug 03 09:40:26.812651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 577/1022] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:27.269035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:40:27.269582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba (ip 10.222.0.20) !!! Aug 03 09:40:27.788936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:27.789547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:27.795941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:27.796380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:27.797156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:27.797583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:27.925466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:40:27.932780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2bd11917-b059-41da-b3d0-8ac3d7342afe tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.147767 Aug 03 09:40:27.933383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 578/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:40:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:40:27.937837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:27.940633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:27.946188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:27.946640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:27.947370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:27.947793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:27.976049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a89b9c3b-668a-448e-a681-3e4a54faec6a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041703 Aug 03 09:40:27.976578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 579/1024] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:40:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:40:28.249896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:40:28.250390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:40:28.256634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:28.257125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:28.257893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:40:28.258335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:40:38.254565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=22 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:38.276161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=20 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:40:43.476823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:40:43.477330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:40:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba (ip 10.222.0.20) !!! Aug 03 09:41:28.913081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:41:28.915343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:41:28.917998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:41:28.919401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:41:28.921222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:28.922676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:41:28.924078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) Aug 03 09:41:28.925801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:41:28.927346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-90a8424e-de57-4904-ab81-4f9794c7f539) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:41:28.927346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-67a3a904-3a3c-4840-acf4-846435aafd9f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 120.381023 Aug 03 09:41:28.927346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 446/1025] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:39:28 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 120382 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:41:28.927346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:28.927800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:28.930794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:28.931273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:28.932601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:28.933143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:29.073594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:41:29.081035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7fbbb32e-46c4-4bf4-8f97-6f69214c0b74 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.161140 Aug 03 09:41:29.081603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 447/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:41:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:41:29.154673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:29.156990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:29.164721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:29.165204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:29.166010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:29.166638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:29.198987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c6f433af-2c6b-480f-ac14-f839c24f6ef0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.116106 Aug 03 09:41:29.200061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 448/1027] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:41:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:41:29.205097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:29.205627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:29.208966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:41:29.211627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:29.212080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:29.214043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:29.214043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:39.209464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:41:39.214172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:41:39.233214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=16 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:41:59.516229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:41:59.518412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:41:59.520102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:41:59.521166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:41:59.522899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:59.525787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:41:59.527149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) Aug 03 09:41:59.528582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:41:59.530833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f871369-cf3e-4901-9a86-923b440020c8) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:41:59.530833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5573a584-d4e7-4d12-a06c-ed77b134c0e8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 91.273944 Aug 03 09:41:59.530833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 580/1028] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:40:28 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 91275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 03 09:41:59.530833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:59.531234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:59.535276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.535727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:59.536479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.536953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:59.563791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:41:59.684326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:41:59.692345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d87afe88-5bf4-4085-9c0f-86da7016fe87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1567 microversion: 2.1 time: 0.170755 Aug 03 09:41:59.692941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 581/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:41:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:41:59.697457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:59.699547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:59.706031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.706471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:59.707228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.707660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:59.737205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-52055348-ea58-4f96-8d66-9a0ef6236bcc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043122 Aug 03 09:41:59.737692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 582/1030] 10.222.0.20 () {60 vars in 1343 bytes} [Wed Aug 3 09:41:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:41:59.742225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:41:59.742711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:41:59.749097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.749544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:41:59.750303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:41:59.750733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:42:09.569001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:42:09.746120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:42:09.769126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=16 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:42:15.042622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:42:15.043206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:42:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 (ip 10.222.0.20) !!! Aug 03 09:42:20.557129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:42:20.557806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 (ip 10.222.0.20) !!! Aug 03 09:42:42.707956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:42:42.708564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:42:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba (ip 10.222.0.20) !!! Aug 03 09:42:43.875443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:42:43.876025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 (ip 10.222.0.20) !!! Aug 03 09:43:29.358356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:43:29.360554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:43:29.362295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:43:29.363333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:43:29.364701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:43:29.366133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:43:29.368037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) Aug 03 09:43:29.369382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:43:29.370661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-15135024-1c8b-4017-be83-c7cbb74675d7) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:43:29.370661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-da3fe051-dec7-43ff-a0ca-750dab44c912 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 120.161190 Aug 03 09:43:29.370661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 449/1031] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:41:29 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 120162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:43:29.371631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:43:29.373837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:43:29.380002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.380475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.381270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.381717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.409450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid 9b12ac06-e52e-4590-b8ab-1007b884d39a {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:43:29.411014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6f590d71-da70-4c11-890b-afe97b7cb061 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Aug 03 09:43:29.411862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 450/1032] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:43:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:43:29.417169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:43:29.419296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:43:29.425145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.425587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.426345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.426770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.504617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b81f7a00-5fc8-4530-94ed-f173b1ad9536 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action" status: 200 len: 37776 microversion: 2.20 time: 0.091514 Aug 03 09:43:29.505475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 451/1033] 10.222.0.20 () {62 vars in 1319 bytes} [Wed Aug 3 09:43:29 2022] POST /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5/action => generated 37776 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:43:29.576655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:43:29.577279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:43:29.584800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.585282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.586573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.587006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.612361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:43:29.685424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ceee4ab6-21a8-4eb6-bfb2-a28eb282e7d6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 204 len: 0 microversion: 2.1 time: 0.178749 Aug 03 09:43:29.686010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 452/1034] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:43:29 2022] DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:43:29.740147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-ee0c88df-b919-4b29-b608-c544524d3dd4 req-c5298100-022d-4f29-844d-512d367fef7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:43:29.750616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ee0c88df-b919-4b29-b608-c544524d3dd4 req-c5298100-022d-4f29-844d-512d367fef7b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.751113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-ee0c88df-b919-4b29-b608-c544524d3dd4 req-c5298100-022d-4f29-844d-512d367fef7b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.761493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-ee0c88df-b919-4b29-b608-c544524d3dd4 req-c5298100-022d-4f29-844d-512d367fef7b service nova] Creating event network-changed:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:43:29.766322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-ee0c88df-b919-4b29-b608-c544524d3dd4 req-c5298100-022d-4f29-844d-512d367fef7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079015 Aug 03 09:43:29.766894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 453/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:43:29.771966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:43:29.772528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:43:29.779567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.780037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:29.780790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:29.781239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:39.413392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:43:39.777488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:43:39.799914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:43:47.277197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:43:47.277800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba (ip 10.222.0.20) !!! Aug 03 09:43:59.721800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-56bc7e1a-e2c8-4c60-a705-086ade0f98b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4" status: 202 len: 0 microversion: 2.1 time: 119.982920 Aug 03 09:43:59.722582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 583/1036] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:41:59 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 => generated 0 bytes in 119984 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:43:59.729027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:43:59.729610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:43:59.736629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:59.737186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:59.737889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:43:59.738327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:43:59.763561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:44:03.484720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:44:03.485415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:44:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba (ip 10.222.0.20) !!! Aug 03 09:44:09.735718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:44:09.762184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:44:09.777627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:45:29.847222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid 9b12ac06-e52e-4590-b8ab-1007b884d39a {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:45:29.880544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:45:29.883089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:45:29.884643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:29.885967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:29.887084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:29.888266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:29.889338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) Aug 03 09:45:29.890501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:29.891595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4af69547-da4b-4049-861a-492cf7ebeb5c) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:45:29.891595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d6184c8-4d72-4783-988a-5b7e594baaf3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 120.117132 Aug 03 09:45:29.891595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 454/1037] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:43:29 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 120119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:45:29.893330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:45:29.895491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:45:29.902287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:29.902726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:29.903479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:29.903902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:29.932731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4b6deac1-cb5f-49f9-b538-45ae258b834a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Aug 03 09:45:29.933630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 455/1038] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:45:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:45:29.938349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:45:29.938979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:45:29.944993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:29.945435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:29.946194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:29.946623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:29.972426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:45:30.032551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.compute.api [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Instance is already in deleting state, ignoring this request Aug 03 09:45:30.033559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-52d96a6d-42a4-4db4-86a0-a1bf9c239f7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 204 len: 0 microversion: 2.1 time: 0.099011 Aug 03 09:45:30.035050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 456/1039] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:45:29 2022] DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:45:30.041848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:45:30.042463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:45:30.048876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:30.049420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:30.050258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:30.050760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:30.105039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Request method failure captured: Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 HTTP/1.1 Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kDs3VaySaYdUT1NNDX4RKHPJjOvHmvIh57zvH1dU-nYQZ0ZtvJy2Cob0_2TVI8IgnyHJJ4eTSTGOYkq4wal_nM1ZDCLNxGYz8r_LdtoRNMwVLIDHHZ_DZ19iV7uTI-5FtBmqJ_UxBkB3-Cvp6CRdQfvy_UsOBJGs1lpeBSh97jR5pM Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:45:30.107438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}] Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 5bc1f887a65c4473bed69bed5dc8fe9f Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:45:30.108721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '9b12ac06-e52e-4590-b8ab-1007b884d39a', 'id': '1a566152-3024-463a-a81b-2b874950c0a4'} Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:30.109590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:30.110638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:30.111790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:30.112991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) Aug 03 09:45:30.115837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:45:30.117489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2380a784-7263-4702-ab60-1c0b01183d69) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:45:30.117489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d22be777-face-4bd6-bc5b-c269703eea7b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4" status: 400 len: 269 microversion: 2.1 time: 90.384776 Aug 03 09:45:30.117489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 584/1040] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:43:59 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 => generated 269 bytes in 90387 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:45:30.118451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:45:30.119065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:45:30.128134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:30.128603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:30.129384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:30.129815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:30.199606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:45:35.050732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:45:35.051233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 (ip 10.222.0.20) !!! Aug 03 09:45:40.048757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:45:40.123418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:45:40.148684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=8 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:45:40.203941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:45:40.566002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:45:40.566226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:45:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 (ip 10.222.0.20) !!! Aug 03 09:45:59.909326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid 9b12ac06-e52e-4590-b8ab-1007b884d39a {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:45:59.937554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:45:59.941268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:45:59.942814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:59.943459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:45:59.944618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:59.946379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:59.947431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) Aug 03 09:45:59.948756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:45:59.950799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-41e38f95-4760-49b6-b992-7ed780e52dc8) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:45:59.950799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66759b6d-f81f-444a-8719-7299c1deba2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 29.910939 Aug 03 09:45:59.950799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 457/1041] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:45:30 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 29912 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:45:59.953991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:45:59.956836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:45:59.963718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:59.964191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:59.964987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:45:59.965422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:45:59.996256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00c978e3-2548-4228-96b2-c09054771011 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Aug 03 09:45:59.997095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 458/1042] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:45:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:00.001579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.002066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.008298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.008932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.009718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.010162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.036011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:46:00.089703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Request method failure captured: Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 HTTP/1.1 Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kDs3VaySaYdUT1NNDX4RKHPJjOvHmvIh57zvH1dU-nYQZ0ZtvJy2Cob0_2TVI8IgnyHJJ4eTSTGOYkq4wal_nM1ZDCLNxGYz8r_LdtoRNMwVLIDHHZ_DZ19iV7uTI-5FtBmqJ_UxBkB3-Cvp6CRdQfvy_UsOBJGs1lpeBSh97jR5pM Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:46:00.091865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}] Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 5bc1f887a65c4473bed69bed5dc8fe9f Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.093513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '9b12ac06-e52e-4590-b8ab-1007b884d39a', 'id': '1a566152-3024-463a-a81b-2b874950c0a4'} Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.094228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.095364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.096611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.097723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) Aug 03 09:46:00.098895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.099957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-43830b3d-56b9-484b-983c-21ffeab25f35) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:46:00.099957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bf42ced-e99b-4c48-bd1b-a59f1465ff99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4" status: 400 len: 269 microversion: 2.1 time: 29.982365 Aug 03 09:46:00.099957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 585/1043] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:45:30 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 => generated 269 bytes in 29984 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:46:00.101511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.compute.api [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Instance is already in deleting state, ignoring this request Aug 03 09:46:00.101511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-87b7e2ca-5cd7-42f6-a6d8-d194828b76bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 204 len: 0 microversion: 2.1 time: 0.100889 Aug 03 09:46:00.101511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 459/1044] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:45:59 2022] DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:46:00.105111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.105616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.108890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.109520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.115337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.115811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.116331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.117304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.117427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.117802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.118155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.118572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.206152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid 9b12ac06-e52e-4590-b8ab-1007b884d39a {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:46:00.251503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:46:00.279718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Request method failure captured: Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 HTTP/1.1 Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kDs3VaySaYdUT1NNDX4RKHPJjOvHmvIh57zvH1dU-nYQZ0ZtvJy2Cob0_2TVI8IgnyHJJ4eTSTGOYkq4wal_nM1ZDCLNxGYz8r_LdtoRNMwVLIDHHZ_DZ19iV7uTI-5FtBmqJ_UxBkB3-Cvp6CRdQfvy_UsOBJGs1lpeBSh97jR5pM Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:46:00.282246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}] Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 5bc1f887a65c4473bed69bed5dc8fe9f Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.283592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '9b12ac06-e52e-4590-b8ab-1007b884d39a', 'id': '1a566152-3024-463a-a81b-2b874950c0a4'} Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.284484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.285539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.286707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.287763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) Aug 03 09:46:00.289276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.291696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f807ec0a-0252-477f-93e1-3704b0e75c58) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:46:00.293070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a70f4dc-0be1-4637-8193-ef1ae8e614ac tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4" status: 400 len: 269 microversion: 2.1 time: 0.192475 Aug 03 09:46:00.294232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 460/1045] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:46:00 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:46:00.299247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.302463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.310800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.311481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.312701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.313192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.318629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:46:00.321902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:46:00.323253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.323894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.325245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.326710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.327727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) Aug 03 09:46:00.328803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.329954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2d828f94-39b9-454f-a8f7-496db495eee6) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:46:00.329954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26017cfc-5ecf-464a-a481-6c63ba6f310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 0.232305 Aug 03 09:46:00.329954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 586/1046] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:46:00 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 234 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:46:00.334847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.335346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.341783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.342231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.343137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.343578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.345135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-da38562c-6c64-4eb3-bfd5-8d8746bfe5cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049627 Aug 03 09:46:00.346086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 461/1047] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:00.350856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.352103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.358325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.358717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.359484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.360231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.371412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:46:00.455039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'services' on Instance uuid 3d91625e-8ed4-43db-8a95-714abb859a9c {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:46:00.462170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9d824cad-98b9-4cb6-a4ec-dd8ce6812a04 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 204 len: 0 microversion: 2.1 time: 0.132004 Aug 03 09:46:00.465992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 587/1048] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:46:00 2022] DELETE /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:46:00.469242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.470438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.477354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.477806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.478691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.479134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.525718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba HTTP/1.1 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:46:00.528368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 09:46:00.529750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '3d91625e-8ed4-43db-8a95-714abb859a9c', 'id': '81d0c922-cbca-483f-ad58-bde813a31cba'} Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.530482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.532501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.537974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.539806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) Aug 03 09:46:00.543007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.545258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d89f9db-e365-4db7-9899-5b948e48b3c7) {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:46:00.545258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e437c79-6c56-4a19-8647-ea6111596b8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba" status: 400 len: 269 microversion: 2.1 time: 0.182803 Aug 03 09:46:00.545258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 462/1049] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:46:00 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments/81d0c922-cbca-483f-ad58-bde813a31cba => generated 269 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:46:00.545258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.545808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.556287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.556733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.557540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.557970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.585975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid 9b12ac06-e52e-4590-b8ab-1007b884d39a {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:46:00.597556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-478cf7b3-48e2-4bbe-90ce-13cf32914b86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061313 Aug 03 09:46:00.598137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 463/1050] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:00.611722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.612368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.620897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.621342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.622300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.622733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.655295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Request method failure captured: Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 HTTP/1.1 Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kDs3VaySaYdUT1NNDX4RKHPJjOvHmvIh57zvH1dU-nYQZ0ZtvJy2Cob0_2TVI8IgnyHJJ4eTSTGOYkq4wal_nM1ZDCLNxGYz8r_LdtoRNMwVLIDHHZ_DZ19iV7uTI-5FtBmqJ_UxBkB3-Cvp6CRdQfvy_UsOBJGs1lpeBSh97jR5pM Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:46:00.657623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}] Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 5bc1f887a65c4473bed69bed5dc8fe9f Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 09:46:00.658961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'server_id': '9b12ac06-e52e-4590-b8ab-1007b884d39a', 'id': '1a566152-3024-463a-a81b-2b874950c0a4'} Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.659800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 09:46:00.661026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.662179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.663211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) Aug 03 09:46:00.666150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:46:00.668851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-98dbf8d1-6582-4ce8-a49d-17559905ad1d) {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:46:00.668851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa8e15d9-9ca1-4c50-8016-5f35463584a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4" status: 400 len: 269 microversion: 2.1 time: 0.194736 Aug 03 09:46:00.668851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 588/1051] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 09:46:00 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a/os-volume_attachments/1a566152-3024-463a-a81b-2b874950c0a4 => generated 269 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:46:00.668851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:00.671371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:00.680229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.681275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.682095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.682533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.714245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:00.717906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee1a4b66-9cd8-44f3-8d7e-205dd76cd3d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057326 Aug 03 09:46:00.718910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 589/1052] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:00.723506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-f2ed4e60-d451-493e-94c9-df28ab85a2fe req-ba5afa1d-b43c-498c-bace-11616d99ee95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab003f4-e418-44ec-93fe-e0d109021fcc", "name": "network-vif-deleted", "tag": "ace62ec6-d1be-4bc7-a577-4a3fb8720a01"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:46:00.726573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-faa7d337-7116-4a62-926d-92151703de1d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.122702 Aug 03 09:46:00.727158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 464/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:00.734178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f2ed4e60-d451-493e-94c9-df28ab85a2fe req-ba5afa1d-b43c-498c-bace-11616d99ee95 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:00.734695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-f2ed4e60-d451-493e-94c9-df28ab85a2fe req-ba5afa1d-b43c-498c-bace-11616d99ee95 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:00.747280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-f2ed4e60-d451-493e-94c9-df28ab85a2fe req-ba5afa1d-b43c-498c-bace-11616d99ee95 service nova] Creating event network-vif-deleted:ace62ec6-d1be-4bc7-a577-4a3fb8720a01 for instance 0ab003f4-e418-44ec-93fe-e0d109021fcc on hv-cinder-84456 Aug 03 09:46:00.752246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-f2ed4e60-d451-493e-94c9-df28ab85a2fe req-ba5afa1d-b43c-498c-bace-11616d99ee95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032118 Aug 03 09:46:00.752907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 590/1054] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:01.612395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:01.614656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:01.621760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.622206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.622968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.623404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.652791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96c35408-03c1-4d5a-8fbf-e7b5d07e3175 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Aug 03 09:46:01.653411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 465/1055] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:01.731719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:01.734011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:01.740082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.740521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.742711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.743203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.748248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:01.748883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:01.754830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.755285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.756048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:01.756480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:01.773631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-22fcd284-53a3-4498-9d02-8e06f4aeff67 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Aug 03 09:46:01.774462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 591/1056] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:01.817981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:01.826277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b11436f8-56dd-4f6d-b14c-d8f5fddea604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082101 Aug 03 09:46:01.826845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 466/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:02.664290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:02.666543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:02.673274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.673718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.674475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.674903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.703976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2c1e12d-ea3d-4595-a7ea-e7b9853418dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 03 09:46:02.704518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 592/1058] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:02.716962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:46:02.717466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:46:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:46:02.785701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:02.787761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:02.794607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.795083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.795840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.796495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.826591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c843a98-a3d2-4538-b00b-3cb55dc49e01 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044850 Aug 03 09:46:02.827144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 467/1059] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:02.847010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:02.847616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:02.854808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.855258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.856021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:02.856480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:02.918857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:02.926368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-522d82de-8166-4471-8da9-3b9a68ce163a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083231 Aug 03 09:46:02.926927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 593/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:03.716354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:03.718522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:03.724948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.725392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:03.726814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.727252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:03.756003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a078d74-39a5-44ba-84c9-4339b044560c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Aug 03 09:46:03.756558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 468/1061] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:03.839307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:03.841574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:03.847641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.848217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:03.848858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.849303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:03.878394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4d93a36e-fdf7-4567-bdab-c1ea1d3616b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Aug 03 09:46:03.878938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 594/1062] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:03.947270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:03.947922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:03.954685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.955123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:03.955874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:03.956300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:04.019099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:04.027125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2df36128-b452-4883-95d1-093eb72bc5d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083778 Aug 03 09:46:04.027684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 469/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:46:04.768341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:04.770435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:04.777979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:04.778456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:04.779211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:04.779636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:04.809244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-66e9b6df-18f1-4609-8589-adc361e09308 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044829 Aug 03 09:46:04.809854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 595/1064] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:04.890497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:04.892640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:04.898965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:04.899411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:04.900170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:04.900601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:04.930220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d71e9229-4769-4b0f-b9c0-2eae92368831 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Aug 03 09:46:04.930765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 470/1065] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:05.048710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:05.049359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:05.056959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.057440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.058215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.058648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.121521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:05.128938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45fe80e2-c2e6-4380-a20b-8752f1a9f895 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084115 Aug 03 09:46:05.129496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 596/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:05.822109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:05.824234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:05.830876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.831314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.832092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.832518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.861412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2eca8196-16c2-4060-a3a2-51731ab53d3f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Aug 03 09:46:05.861968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 471/1067] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:05.942219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:05.945308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:05.951574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.952018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.952768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:05.953220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:05.982203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87645387-b215-435a-a715-650efc9be349 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043926 Aug 03 09:46:05.982736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 597/1068] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:06.149688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:06.150297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:06.156285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:06.156720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:06.157512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:06.157939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:06.176584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:06.222740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:06.230528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b649bc8-97cd-448d-bc21-67ac34b92aa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084761 Aug 03 09:46:06.231087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 472/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:06.873547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:06.875690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:06.882607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:06.883058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:06.883813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:06.884243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:06.912601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00824b70-2de8-47ab-8c0a-52d038d412c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043029 Aug 03 09:46:06.913964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 598/1070] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:06.994680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:06.996841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:07.003244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.003684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.004433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.004882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.035114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63c5ea05-0c18-4fa9-bc86-cfae7ee021f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 Aug 03 09:46:07.035659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 473/1071] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:07.251618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:07.252156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:07.258805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.259252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.260005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.260441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.322920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:07.330612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98cf0580-812c-46ff-baab-4fd484873f2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082990 Aug 03 09:46:07.331171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 599/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:07.925829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:07.927988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:07.934830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.935269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.936018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:07.936440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:07.966165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-890d81a0-04f2-489a-b8c2-0b82508e25e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Aug 03 09:46:07.966698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 474/1073] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:08.047515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:08.049705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:08.057486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.057941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:08.058704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.059136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:08.063046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:08.091401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b37086ca-5c68-4239-a774-8a438e4cf28e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 03 09:46:08.091959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 600/1074] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:08.352704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:08.353333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:08.359721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.360154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:08.360933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.361361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:08.421809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:08.429938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bc5318bd-e991-4459-9975-1f6310e700a3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081946 Aug 03 09:46:08.430512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 475/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:08.978537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:08.980681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:08.986849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.987300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:08.988065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:08.988500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:09.018618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3593a140-fc50-4b92-b38c-0c0f7bc788eb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044165 Aug 03 09:46:09.019174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 601/1076] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:09.102843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:09.105038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:09.111051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:09.111501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:09.112260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:09.112694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:09.141903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0fdc3d43-cc08-4b15-bba6-9c117c566a8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Aug 03 09:46:09.142450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 476/1077] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:09.451597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:09.452232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:09.458633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:09.459071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:09.460519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:09.460980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:09.734599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:09.742804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cbc79621-46ed-48ff-a058-c61d15fa1202 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.295296 Aug 03 09:46:09.743363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 602/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:10.031291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:10.033415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:10.040489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.040964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.041722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.042153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.072274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1aefef2b-df89-4542-a428-9dd4cfafc346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Aug 03 09:46:10.072850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 477/1079] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:10.154308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:10.156471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:10.162464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.162967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.163717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.164142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.192305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c856d81-4498-4a17-83a2-c37a297cbe3c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 Aug 03 09:46:10.192859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 603/1080] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:10.763749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:10.764383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:10.770543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.770983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.771737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:10.772179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:10.833403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:10.841132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9394000-82a5-45de-bc8b-974ded213929 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081238 Aug 03 09:46:10.841703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 478/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:11.084766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:11.086964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:11.093560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.094006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.094767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.095202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.124683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b78d3702-04b9-401f-9c3c-0261bb396cf5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Aug 03 09:46:11.125261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 604/1082] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:11.205182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:11.207378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:11.213846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.214291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.215052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.215485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.244942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f4deb370-f162-4c7a-88b2-de3d48beefb2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 03 09:46:11.245499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 479/1083] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:11.862554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:11.863225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:11.869968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.870418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.871177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:11.871613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:11.931772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:11.939273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f257f876-a747-43b5-aab4-4812a000b147 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080703 Aug 03 09:46:11.939832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 605/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:12.137296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:12.139381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:12.145637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.146085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:12.147372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.147806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:12.177107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01a795e8-3eaa-47b0-ab69-1ff5e0499f26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 Aug 03 09:46:12.177671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 480/1085] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:12.257463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:12.259642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:12.266295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.266751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:12.267528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.267968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:12.298546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c50b4a24-f6aa-44b8-baa4-9337f04e4d52 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Aug 03 09:46:12.299101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 606/1086] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:12.960697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:12.961336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:12.967790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.968236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:12.969029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:12.969465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:13.032579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:13.040730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1562ad1e-38dd-4c6e-ae20-d28eca8742f1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084435 Aug 03 09:46:13.041325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 481/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:13.189639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:13.191778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:13.198882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:13.199581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:13.200346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:13.200768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:13.231071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eabf863b-b089-4d65-af10-58a48d8e18e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Aug 03 09:46:13.231545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 607/1088] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:13.310074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:13.312274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:13.318212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:13.319146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:13.319891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:13.320334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:13.349128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66b6b90c-c603-4e7e-bee7-43512e3b29ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043052 Aug 03 09:46:13.349714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 482/1089] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:14.061099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:14.061707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:14.067856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.068328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.069237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.069710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.131591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:14.139115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54ca11e1-e9c7-452b-ac50-145c5a0b921d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082074 Aug 03 09:46:14.139730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 608/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:14.243830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:14.246008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:14.252533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.253015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.253775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.254282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.283161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0d7a599e-bcc7-4194-bbc0-dde1811bce09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 03 09:46:14.283726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 483/1091] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:14.361324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:14.363530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:14.369534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.369982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.370732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:14.371165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:14.399816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40399e22-4e9c-4a02-9857-0f2a922491f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042411 Aug 03 09:46:14.400351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 609/1092] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:15.159847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:15.160459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:15.168528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.169003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.169773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.170208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.233433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:15.241098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d636317-7ae8-4928-8074-1f21e63b3231 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085157 Aug 03 09:46:15.241669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 484/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:15.295653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:15.297865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:15.304311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.304761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.305547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.305980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.334977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5c2c7f3-48dd-4b14-98af-2f62199e14b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 Aug 03 09:46:15.335520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 610/1094] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:15.412099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:15.414259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:15.420648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.421129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.421893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:15.422330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:15.453434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3888df9-53a1-4df2-bf54-4d17dc1940ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045364 Aug 03 09:46:15.453991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 485/1095] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:16.261997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:16.262626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:16.268595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.269070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.269820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.270249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.330855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:16.338421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-490ed6cd-32fc-44d1-a0b3-8b6ea4c267d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080373 Aug 03 09:46:16.338978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 611/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:16.347165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:16.349353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:16.355950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.356397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.357176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.357606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.386322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4716da1-5758-4c15-b945-4a9f7f983229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043109 Aug 03 09:46:16.386867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 486/1097] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:16.465452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:16.467720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:16.473743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.474195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.474957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:16.475963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:16.504159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01023528-91c4-4b9c-b64f-aefee7e19762 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042645 Aug 03 09:46:16.504705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 612/1098] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:17.359656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:17.360257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:17.367349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.367785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.368536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.368996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.398703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:17.400913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:17.407433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.407883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.408650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.409119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.430326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:17.437846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdf21e9d-839f-4ca1-88e0-7c6db0c3357f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082025 Aug 03 09:46:17.438406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 487/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:17.438530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-05fac929-9a9c-4008-b581-c7aa30add95e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043957 Aug 03 09:46:17.439004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 613/1100] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:17.515343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:17.517513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:17.525640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.526156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.526909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:17.527333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:17.555619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bdac665b-5d1a-4e80-836d-159ff8103b57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044063 Aug 03 09:46:17.556159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 488/1101] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:18.450890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:18.453052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:18.460137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.460580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.461366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.461799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.462048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:18.462665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:18.469116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.469570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.470339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.470775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.474742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:18.491596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-16daa9d1-658b-4600-9d37-a99255b424e4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 03 09:46:18.492349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 614/1102] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:18.532317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:18.539899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-425f73a9-71cf-42d8-9a2a-e0de4a083f63 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082466 Aug 03 09:46:18.540466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 489/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:46:18.567572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:18.570294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:18.576483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.576987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.577749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:18.578187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:18.607101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76f46a3b-2eb7-468b-8431-99adf9dd7bd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Aug 03 09:46:18.607646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 615/1104] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:19.503707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:19.505925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:19.512598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.513074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.513933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.514305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.544222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f108194c-52b7-41f1-96e3-8c73570fc13f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Aug 03 09:46:19.544762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 490/1105] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:19.560742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:19.561440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:19.567938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.568387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.569796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.570237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.619204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:19.621377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:19.627321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.627765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.628521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:19.628983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:19.635849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:19.639181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:19.644015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ba7f4485-88ea-42f8-8f22-f73ee82fe6d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087112 Aug 03 09:46:19.644574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 616/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:19.658471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3883475e-cc76-4407-9245-562b68a41b38 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Aug 03 09:46:19.659023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 491/1107] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:20.557952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:20.560111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:20.561954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=68 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:20.567499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.567939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.569483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.569918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.598870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8cdeddaf-2b65-4e43-8c99-d8acd134dd21 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 03 09:46:20.599415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 617/1108] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:20.665415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:20.666022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:20.668320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=69 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:20.671287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:20.673452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:20.673610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.674055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.674818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.675244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.680334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.680790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.681581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:20.682017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:20.713549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90f22f04-dced-4441-a29e-8b784e49d4e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046075 Aug 03 09:46:20.714114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 618/1109] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:20.741035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:20.748578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7744c07-687f-4702-a98a-59c7c7957159 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087530 Aug 03 09:46:20.749169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 492/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:21.611743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:21.613944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:21.620713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.621192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.621949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.622386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.652007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e03e31cb-7ea0-4399-98b5-6ac062823b00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Aug 03 09:46:21.652556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 619/1111] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:21.725670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:21.727827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:21.734303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.734752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.735516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.735953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.767786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ff7dd0e-7234-4507-8df8-82d9ac319982 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Aug 03 09:46:21.768345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 493/1112] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:21.769201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:21.769818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:21.776600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.777128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.777897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:21.778329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:21.841223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:21.848646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-57d047ce-5283-4109-91ad-9e2c1bcc918c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083238 Aug 03 09:46:21.849243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 620/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:46:22.665003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:22.667109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:22.673058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.673503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.674255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.674674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.703816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f4ec2132-a4aa-4ac0-9bef-1db5d9ceedda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043510 Aug 03 09:46:22.704367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 494/1114] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:22.779491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:22.781668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:22.788823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.789276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.790034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.790467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.819790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ed4115f-ce4d-4af1-9c5c-ca8827237e80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Aug 03 09:46:22.820346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 621/1115] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:22.869300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:22.869909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:22.876286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.876728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.877514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:22.877944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:22.938401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:22.946520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1544ae01-eb9b-4818-965b-5172eb0c09a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081056 Aug 03 09:46:22.947089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 495/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:23.716138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:23.718362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:23.724328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.724775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:23.725544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.725973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:23.754175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f3a4595-c7a2-4355-9e75-3f4e6045e1b6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Aug 03 09:46:23.754714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 622/1117] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:23.832591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:23.835655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:23.841855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.842298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:23.843055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.843484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:23.882412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c401436-899a-46a9-a507-f27535eef3e1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053773 Aug 03 09:46:23.883053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 496/1118] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:23.968401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:23.968953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:23.976093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.976596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:23.977379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:23.977812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:24.038552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:24.045858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d79d5f72-c825-448b-8a20-6955a8f8d80d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081427 Aug 03 09:46:24.046412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 623/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:24.767183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:24.769425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:24.775644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:24.776090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:24.776870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:24.777307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:24.806107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b6c521e-3232-4afd-84fb-aa8d4535b48f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Aug 03 09:46:24.806656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 497/1120] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:24.894541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:24.896735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:24.902806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:24.903251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:24.904003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:24.904430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:24.933149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd14b2fb-0f7c-4cc3-a88e-3bead5e917d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042443 Aug 03 09:46:24.933684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 624/1121] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:25.066980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:25.067582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:25.074892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.075330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.076076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.076504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.137736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:25.145156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d1230f0a-e15c-4eec-9aa8-f85a5ffa8dae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081945 Aug 03 09:46:25.145660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 498/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:25.818456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:25.821179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:25.827781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.828222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.829013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.829432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.857987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7c62b85-cec0-4240-8556-2f1152690e7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 03 09:46:25.858515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 625/1123] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:25.945739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:25.947903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:25.954467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.954914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.955665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:25.956090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:25.985677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7ac59b25-fa6d-4b34-a2d2-693a2ec311cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044544 Aug 03 09:46:25.986227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 499/1124] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:26.166141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:26.166749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:26.172709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:26.173182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:26.173926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:26.174352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:26.235349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:26.243413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e490c20-0c56-46d9-8cdd-416eeadfcdeb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081214 Aug 03 09:46:26.243960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 626/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:26.870434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:26.872592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:26.879220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:26.879667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:26.880432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:26.880904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:26.910379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2e9f3887-788f-45ad-bcda-1a04d4e307ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 03 09:46:26.910938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 500/1126] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:26.998511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:27.000701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:27.007308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.008480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.009280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.009720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.038017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c2c8c9c-40f9-4b1c-8273-1bb54c6da7b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043476 Aug 03 09:46:27.038561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 627/1127] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:27.264422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:27.264994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:27.270892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.271326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.272069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.272493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.335242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:27.342974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ebd2e7a1-ff8d-46ce-9a7f-6dd91cfe522a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082494 Aug 03 09:46:27.343531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 501/1128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:27.922623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:27.924780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:27.930746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.931188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.931942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:27.932370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:27.961071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ec8d15d3-3816-440e-b862-616cef8c6048 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Aug 03 09:46:27.961614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 628/1129] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:28.050333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:28.052507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:28.059080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:28.059529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:28.060290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:28.060718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:28.091219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45c92de5-feac-4aef-8ecb-49ef3d3ad7b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Aug 03 09:46:28.091771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 502/1130] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:28.363383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:28.363995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:28.370512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:28.370949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:28.371700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:28.372123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:28.436508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:28.444038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a8ca621d-ac3b-4ad4-a7f5-ac414481d05a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084495 Aug 03 09:46:28.444608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 629/1131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:29.087133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:29.089371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:29.095431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.095870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.096625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.097081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.128199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-598e2371-38c1-496b-be72-14616eae8a39 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158962 Aug 03 09:46:29.128920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 503/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:29.219807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:29.221978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:29.228585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.229015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.229768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.230196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.258046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2663cf6a-de6a-477f-8caf-d942c5bc751d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158593 Aug 03 09:46:29.258589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 630/1133] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:29.466321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:29.466936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:29.472904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.473351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.474114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:29.474545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:29.649275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:29.656701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b289249-a129-4878-b47a-7b60383c4104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.194235 Aug 03 09:46:29.657291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 504/1134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:30.139646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:30.141797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:30.148401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.148868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.149621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.150049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.178372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3255807c-47e1-4e23-82ed-c8f361e7a4fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Aug 03 09:46:30.178929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 631/1135] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:30.270102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:30.272285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:30.279435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.279878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.280624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.281079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.306134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:30.311220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9bd96087-7fbc-44b8-8e2b-bdf30ad34b88 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Aug 03 09:46:30.311771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 505/1136] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:30.678408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:30.679573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:30.685745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.686197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.686951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:30.687385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:30.748077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:30.755544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b4058aa-b942-4eb2-b5bf-04d7ce5ca9b0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081041 Aug 03 09:46:30.756105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 632/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:31.191413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:31.193603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:31.200717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.201198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.201961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.202413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.231394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb9472e9-077c-46be-89a3-a64eafdd0069 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Aug 03 09:46:31.231967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 506/1138] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:31.324415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:31.326548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:31.334161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.334797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.336196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.336611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.353487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:31.366722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df3203f6-9675-4a8f-bdd7-93f847b3ed50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Aug 03 09:46:31.367277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 633/1139] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:31.777820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:31.778443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:31.784888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.785335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.786081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:31.786509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:31.848853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:31.856281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a0eb0328-be23-42d6-9d6f-0d3f94b02d64 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082521 Aug 03 09:46:31.856858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 507/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:32.243681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:32.245896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:32.251916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.252337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.253121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.253547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.283194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b654292f-1f6e-4c32-bceb-4f17b1f57ef1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Aug 03 09:46:32.283749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 634/1141] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:32.378918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:32.381097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:32.387125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.387576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.388349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.388784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.417912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-057f9937-bbbc-44cb-97c7-032744d98c29 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Aug 03 09:46:32.418464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 508/1142] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:32.877340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:32.877998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:32.885071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.885513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.886261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:32.886687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:32.948058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:32.955465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a4d5e24-5eda-465d-b0af-15e49a415e87 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081985 Aug 03 09:46:32.956052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 635/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:33.295737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:33.297821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:33.305090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.305531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:33.306283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.306711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:33.335125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c2c7a24-24a5-4621-9a9c-f0c76fdafcd2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043415 Aug 03 09:46:33.335676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 509/1144] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:33.430555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:33.432722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:33.438764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.439215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:33.439976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.440420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:33.468966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-64014ba2-18e2-4980-8f4e-eb9bffe8a491 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Aug 03 09:46:33.469507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 636/1145] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:33.977151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:33.977745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:33.983696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.984134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:33.984899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:33.985324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:34.046167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:34.054341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-65119b4e-f114-476d-aeaa-57c43d5975ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080618 Aug 03 09:46:34.054986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 510/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:34.347507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:34.349619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:34.356681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:34.357168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:34.357926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:34.358364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:34.387191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-967db602-abb0-4628-9d23-bcd1e8dae27c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043855 Aug 03 09:46:34.387735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 637/1147] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:34.481989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:34.484136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:34.490503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:34.490942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:34.491693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:34.492123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:34.520316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8cea3433-cee7-43b3-898c-61991caaf451 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042273 Aug 03 09:46:34.520961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 511/1148] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:35.075520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:35.076134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:35.082077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.082513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.083263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.083689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.144181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:35.153418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3fa9505a-aaca-440c-bed0-9980f86f4539 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082053 Aug 03 09:46:35.154895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 638/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:35.399727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:35.401935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:35.408051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.408499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.409316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.409753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.438527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9213419-1239-412d-9238-006d1fbf2d7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Aug 03 09:46:35.439080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 512/1150] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:35.533375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:35.535588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:35.542712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.543167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.543929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:35.544367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:35.575020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45cbb3e0-169b-417b-93f0-080f6a1bbb3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Aug 03 09:46:35.575570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 639/1151] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:36.175011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:36.175636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:36.184638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.185428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.186728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.187454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.258127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:36.266439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25f66385-3bd6-4ca4-b3bd-983944fa73bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.095562 Aug 03 09:46:36.267045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 513/1152] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:36.452112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:36.454255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:36.461331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.461783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.462539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.462962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.497590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d08d8588-ca89-4385-8e1f-e87e72699a7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049757 Aug 03 09:46:36.498252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 640/1153] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:36.587611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:36.591120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:36.597906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.598396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.599157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:36.599584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:36.633869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8cb4795a-9213-4049-afac-de7164f0d87e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050427 Aug 03 09:46:36.634549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 514/1154] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:37.293645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:37.294252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:37.300991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.301430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.302178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.302604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.366494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:37.373939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-43874a2b-1f88-44c8-b97a-b6f57b54e562 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084183 Aug 03 09:46:37.374524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 641/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:37.510357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:37.512536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:37.519053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.519508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.520272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.520707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.550190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9df04982-7c93-4df4-9673-db5879469592 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 03 09:46:37.550736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 515/1156] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:37.648464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:37.650542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:37.656493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.656962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.657710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:37.658138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:37.687214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-408a571d-95da-4c42-a1bb-d0952185284e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Aug 03 09:46:37.687785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 642/1157] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:38.394561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:38.395165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:38.401889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.402332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.403079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.403509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.466433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:38.473995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-86c55d65-efa8-4bf0-8ea0-5bbb0e4d802b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083301 Aug 03 09:46:38.474582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 516/1158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:38.562430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:38.564582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:38.571734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.572175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.573209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.573638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.602560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-baafad1a-4407-46e3-b5f4-98597f465aec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044081 Aug 03 09:46:38.603102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 643/1159] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:38.698996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:38.701099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:38.707538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.707990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.708748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:38.709206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:38.738523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fb412e91-ca30-4879-800e-eb50e114541b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 Aug 03 09:46:38.739079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 517/1160] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:39.495924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:39.496538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:39.502633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.503085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.503843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.504280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.565888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:39.574131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ed51457-1d41-4a2a-b973-c5159b94e3fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082064 Aug 03 09:46:39.574701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 644/1161] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:39.614828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:39.617594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:39.624509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.624994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.625759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.626193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.655537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55167a8d-74f2-4709-96dd-4ad857e7e5ad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044668 Aug 03 09:46:39.656087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 518/1162] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:39.751458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:39.753599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:39.759895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.760451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.761136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:39.761571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:39.791822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-49989b9c-1bb6-459b-9e88-328125c24fcd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Aug 03 09:46:39.792361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 645/1163] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:40.594833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:40.595433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:40.602532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.602973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.603720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.604146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.666188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:40.668483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:40.670732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:40.673826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77a8cbe3-980b-43d0-beae-fcfccca19dc4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082860 Aug 03 09:46:40.674500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 519/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:40.677401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.677847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.678619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.679053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.707902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bf77414c-7f3a-4068-9079-3ea276bc3705 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Aug 03 09:46:40.708448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 646/1165] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:40.805064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:40.807220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:40.813275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.813727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.814542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:40.814978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:40.843474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6d773c39-46d8-43e4-a3a2-b7941203aaf2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043156 Aug 03 09:46:40.844023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 520/1166] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:41.695276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:41.695997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:41.702846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.703296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.704061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.704497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.720399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:41.722754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:41.730061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.730615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.731411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.731814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.762252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e3d47f2-0a70-4503-bec7-617b8293531e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045745 Aug 03 09:46:41.762849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 521/1167] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:41.780444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:41.788023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-629ced52-533c-4f94-82c8-f6cacc934d43 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.096666 Aug 03 09:46:41.788877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 647/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:41.857084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:41.859281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:41.865177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.865677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.866475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:41.866899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:41.883933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:41.896946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e93468b-41ea-414d-a9ec-7043114b4d69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Aug 03 09:46:41.898137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 522/1169] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:42.774948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:42.777048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:42.783517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.783956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.784708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.785170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.808166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:42.808906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:42.815102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f8e2fc9f-d019-45dd-ba56-ab4021e1b6ab tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045157 Aug 03 09:46:42.815270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.815662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 648/1170] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:42.815818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.816460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.816917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.880185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:42.887672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e959d26-fac5-476f-87c1-a924c651cbc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083385 Aug 03 09:46:42.888237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 523/1171] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:42.909548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:42.911752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:42.918771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.919245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.920010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:42.920448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:42.950398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e9e8ece3-77e7-47bd-b20b-57dffd65c337 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Aug 03 09:46:42.950943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 649/1172] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:43.828060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:43.830283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:43.836837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.837293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.838044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.838467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.867490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aa6a2c0a-103f-4fa3-8cc2-f917d633f603 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Aug 03 09:46:43.868043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 524/1173] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:43.908991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:43.909613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:43.916725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.917202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.917963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.918399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.922325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:43.962839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:43.965096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:43.971119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.971572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.972336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:43.972770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:43.983142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:43.991238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98aba2b9-5496-4473-b627-5323f6702fd0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085538 Aug 03 09:46:44.003542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 650/1174] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:44.003728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d06289a-e2c5-4220-85ab-c07a01444a62 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Aug 03 09:46:44.003728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 525/1175] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:44.879814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:44.882036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:44.887957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:44.888394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:44.889171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:44.889598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:44.918892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6b104f45-77d6-4168-b988-2b5fecf55c8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Aug 03 09:46:44.919540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 651/1176] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:45.011531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:45.012140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:45.014096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:45.016252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:45.018700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.019141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.019901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.020364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.023074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.023577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.024370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.024825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.054790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7036aa7-04bc-4be8-a826-04b960cf52b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 Aug 03 09:46:45.055361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 652/1177] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:45.083243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:45.091305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a3fd1c5c-032e-432b-ba02-4dec81da05e1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083628 Aug 03 09:46:45.091872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 526/1178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:46:45.931621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:45.933789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:45.940234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.940679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.941512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:45.941947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:45.972012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ba4443c-639f-4a71-9163-f80cbf255e3c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 03 09:46:45.972561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 653/1179] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:46.066988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:46.069421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:46.076213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.076652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:46.077442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.077870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:46.108871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dad4a546-b049-40b0-9588-47a3ca8b2edd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045689 Aug 03 09:46:46.109606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 527/1180] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:46.118732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:46.119347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:46.125331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.125779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:46.126542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.126964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:46.188651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:46.196705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4a91ff80-d1d0-4458-8bd3-e4e1f715c76d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086947 Aug 03 09:46:46.197562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 654/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:46.984541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:46.986730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:46.993308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.993761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:46.994518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:46.994951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:47.024884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25f15963-6f81-4d1f-b2b8-726469683671 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 03 09:46:47.025436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 528/1182] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:47.120289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:47.122503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:47.128989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:47.129437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:47.130199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:47.130634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:47.160421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10bcf1cb-cdf5-450c-9a60-4f668347f9de tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Aug 03 09:46:47.160995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 655/1183] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:47.217806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:47.218415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:47.224960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:47.225412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:47.226167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:47.226597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:47.290657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:47.298157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c3344b9e-f6ca-4e61-9934-e04d00b869b1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084217 Aug 03 09:46:47.298748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 529/1184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:48.036556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:48.039567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:48.045548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.045990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.046735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.047163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.076441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32bc115b-f46e-4238-84f0-35cfff29f939 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043844 Aug 03 09:46:48.077006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 656/1185] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:48.171515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:48.173696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:48.179732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.180163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.180951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.181388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.210523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d556ecd8-9327-4429-85dc-acf1d014890b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Aug 03 09:46:48.211081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 530/1186] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:48.320136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:48.320741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:48.327455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.327893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.328638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:48.329088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:48.389726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:48.397809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6820f416-982b-49e0-9388-f70d0d99b602 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081706 Aug 03 09:46:48.398365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 657/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:49.087709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:49.089924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:49.096457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.096946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.097709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.098142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.128031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b76ebc4-e5fc-4030-bd20-1f23991b31bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Aug 03 09:46:49.128590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 531/1188] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:49.222938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:49.225866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:49.231866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.232306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.233080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.233510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.262234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b7c7298e-e52c-4238-8a5c-526cb962cf89 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Aug 03 09:46:49.262770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 658/1189] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:49.419081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:49.419681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:49.425631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.426071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.426815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:49.427242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:49.487036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:49.495852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bb5d7cf3-e1ce-4ed2-ab44-dee6874295a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080674 Aug 03 09:46:49.496419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 532/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:50.140592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:50.142808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:50.149573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.150021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.150782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.151215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.179850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-727c18d3-ef1e-40b4-8abf-5ac654a9bec8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042748 Aug 03 09:46:50.180398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 659/1191] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:50.274524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:50.276568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:50.283033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.283469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.284215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.284636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.314766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-521561a1-1aa8-45e2-b3ed-e8272d3e6819 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Aug 03 09:46:50.315317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 533/1192] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:50.517129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:50.517760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:50.523904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.524348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.525182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:50.525593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:50.586209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:50.593592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-768d9965-2d24-4dd6-a841-68732baaf927 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080361 Aug 03 09:46:50.594148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 660/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:51.192038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:51.194207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:51.196357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=84 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:51.201893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.202339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.203095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.203527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.234556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9cc7a269-9676-4506-a69e-247711e40fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046480 Aug 03 09:46:51.235111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 534/1194] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:51.327434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:51.330373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:51.334142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=88 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:51.339137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.339577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.340365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.340793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.369672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26303ab7-1d7f-40a4-8467-294b5f5661ef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 03 09:46:51.370220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 661/1195] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:51.615165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:51.615779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:51.622719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.623161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.623915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:51.624348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:51.684671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:51.692160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3ff37a0-6db4-4fdb-830b-73efc06a58cb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080887 Aug 03 09:46:51.692731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 535/1196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:52.246626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:52.248771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:52.254717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.255169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.256009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.256442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.285441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-47ce8221-f1af-42d9-b32f-27949ae8ad7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Aug 03 09:46:52.285993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 662/1197] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:52.380937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:52.383153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:52.389139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.389581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.390328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.390753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.419859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b6eeb295-ce04-467e-a444-d60f93185649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Aug 03 09:46:52.420413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 536/1198] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:52.715270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:52.715818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:52.722265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.722712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.723464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:52.723897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:52.790505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:52.798108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76e13e00-7ca9-4909-9934-37cfc6f9a9f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087741 Aug 03 09:46:52.798684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 663/1199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:53.298058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:53.300245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:53.307036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.307418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.308180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.308616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.337930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-83c1f19f-97fe-4db2-ac20-15c56db5f8bd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 03 09:46:53.338491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 537/1200] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:53.432268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:53.434437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:53.440429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.440906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.441666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.442097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.475364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af6af321-0413-4dc5-b3c3-86f82dc5849e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047332 Aug 03 09:46:53.475982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 664/1201] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:53.818830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:53.819498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:53.826487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.826933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.827688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:53.828118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:53.889351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:53.896752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d470530-d1ee-4ea0-a9a1-b48721e16696 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081789 Aug 03 09:46:53.897344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 538/1202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:54.350532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:54.353424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:54.359913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.360360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.361143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.361576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.389985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-75b53723-ee88-45ed-b5d0-1da2eb92d48d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043448 Aug 03 09:46:54.390518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 665/1203] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:54.488825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:54.490962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:54.498186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.498655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.499409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.499834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.503578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:54.528501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc4ebc3d-2012-4906-b9b4-cb9509e77048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Aug 03 09:46:54.529074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 539/1204] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:54.918466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:54.918991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:54.924953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.925393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.926137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:54.926561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:54.987153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:54.990486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:46:54.995414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ff983c8-aa0b-4046-9ca4-01d5016d9085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080971 Aug 03 09:46:54.995973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 666/1205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:55.402046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:55.404183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:55.410207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:55.410658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:55.411419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:55.411852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:55.441293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-24794c86-3c6c-4536-a9b2-dcacb04493b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 03 09:46:55.441838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 540/1206] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:55.541814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:55.544122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:55.550697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:55.551139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:55.551882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:55.552311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:55.580784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30f328a2-0258-444f-bd6a-ef265d6117a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 03 09:46:55.581345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 667/1207] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:56.016947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:56.017553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:56.024586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.025060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.025811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.026239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.090068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:56.097799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-173ec295-a282-4319-892e-5c9dda83f153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084726 Aug 03 09:46:56.098423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 541/1208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:56.454212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:56.456401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:56.462607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.463046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.463793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.464225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.493279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8dd0a56b-9906-4029-9c3b-5f846c2f477f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042991 Aug 03 09:46:56.493812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 668/1209] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:56.593218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:56.595352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:56.601916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.602352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.603096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:56.603545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:56.632140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f880c2b-0bf5-4e7d-b707-d10137c3e812 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042779 Aug 03 09:46:56.632727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 542/1210] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:57.119690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:57.120299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:57.126773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.127209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.127954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.128381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.188672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:57.196133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c1d67a6-c075-4f0f-a525-77df3cf47805 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080547 Aug 03 09:46:57.196980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 669/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:57.505596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:57.508233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:57.514749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.515190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.515970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.516399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.546078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3fe650f4-4ab0-4cf1-a48b-97aadebff819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044464 Aug 03 09:46:57.546619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 543/1212] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:57.645428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:57.647627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:57.653589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.654029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.654768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:57.655193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:57.685408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23ebda39-4db2-4cf5-b6fa-aa5c32205e1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Aug 03 09:46:57.685966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 670/1213] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:58.217420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:58.218032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:58.224021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.224461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.225251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.226186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.285266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:58.293176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ab47c0c-1913-40dd-ad9a-37c8c3f17942 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079604 Aug 03 09:46:58.293741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 544/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:58.558002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:58.560190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:58.566679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.567117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.567864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.568290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.597382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1c9654b-11a8-4989-9cf1-9c5599e37319 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Aug 03 09:46:58.597919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 671/1215] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:58.697956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:58.700117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:58.706568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.707020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.707779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:58.708214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:58.738122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-15ece798-a8f5-4ffa-860a-f1a53bf982ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044500 Aug 03 09:46:58.738686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 545/1216] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:46:59.314810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:59.315346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:59.322305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.322745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.323495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.323922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.385111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:46:59.392644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58735433-cd55-435a-83ae-275c489e1b4a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081810 Aug 03 09:46:59.393250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 672/1217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:46:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:46:59.610541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:59.612763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:59.619481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.619929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.620692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.621165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.649983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3c1ca4e-8bb6-480e-acd8-6885733ab7f0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043417 Aug 03 09:46:59.650539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 546/1218] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:46:59.750440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:46:59.752609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:46:59.759072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.759520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.760271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:46:59.760709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:46:59.789242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f070cf5e-1513-4b3f-a198-34ceeb09def2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Aug 03 09:46:59.789782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 673/1219] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:46:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:00.412955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:00.413892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:00.420310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.420758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.421559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.422116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.484147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:00.491910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-32819e01-a9c5-490b-a688-8e67729cdf97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082895 Aug 03 09:47:00.492480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 547/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:00.662177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:00.665077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:00.671184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.671625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.672373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.672800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.700860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-972cf4dc-9654-409e-8839-8b4ac2aa64f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Aug 03 09:47:00.701402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 674/1221] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:00.801276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:00.803982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:00.809941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.810384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.811127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:00.811557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:00.841955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5b23205f-a0b7-4864-a77d-3651b1dc8450 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Aug 03 09:47:00.842514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 548/1222] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:01.513457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:01.514064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:01.520626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.521098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.521846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.522912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.585944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:01.593382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b3cce2e1-5772-4672-8d90-5f523bac1094 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083793 Aug 03 09:47:01.593940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 675/1223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:01.713499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:01.715635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:01.722076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.722511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.723262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.723685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.752344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-af1a77ee-6670-4814-9ce3-1b6bd5f62e41 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043306 Aug 03 09:47:01.752905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 549/1224] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:01.854070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:01.856909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:01.862897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.863349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.864091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:01.864595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:01.894472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c7c3611b-4b31-4e41-a76f-22e3e3bfb8a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Aug 03 09:47:01.895029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 676/1225] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:02.614756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:02.615369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:02.621999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.622441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.623196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.623747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.687870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:02.695664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca79ef73-1c7f-449d-ad06-d78160e613ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084857 Aug 03 09:47:02.696486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 550/1226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:02.765024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:02.767142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:02.774007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.774448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.775202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.775649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.806076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e91ecd8b-7698-4a33-8889-af65fad35d4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Aug 03 09:47:02.806558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 677/1227] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:02.906844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:02.909019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:02.916049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.916489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.917263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:02.917686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:02.947201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e52d2c8d-940d-43ab-9ed1-bd40a6b46b2f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Aug 03 09:47:02.947755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 551/1228] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:03.717198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:03.717814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:03.723867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.724317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.725102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.726147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.785829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:03.793868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eaf300f3-3f9d-4c33-8683-030f25065ae3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080644 Aug 03 09:47:03.794431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 678/1229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:03.818899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:03.822246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:03.830811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.831259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.832018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.832451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.862459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-94d409f0-35b0-42d6-8bad-8f337f162523 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Aug 03 09:47:03.863005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 552/1230] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:03.960098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:03.962340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:03.968341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.968729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.969507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:03.969934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:03.998952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1229f13a-b3c4-498f-8595-b437a950324b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 03 09:47:03.999494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 679/1231] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:04.814306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:04.814836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:04.821848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:04.822297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:04.823055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:04.823496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:04.875225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:04.877382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:04.884335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:04.884779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:04.886157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:04.886157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:04.889031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:04.896609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08d270e3-fef9-4555-ae8c-7e18c5e1f507 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086203 Aug 03 09:47:04.898245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 553/1232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:04.919188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-996c1383-fc54-4e78-924a-1fc0642f8e7e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047922 Aug 03 09:47:04.919728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 680/1233] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:05.011085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:05.013228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:05.019173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.019702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.020626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.021079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.049784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0fd86b49-6a93-4ee1-b7d3-afb0049230c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 Aug 03 09:47:05.050327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 554/1234] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:05.919195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:05.919741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:05.926266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.926706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.927463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.927895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.931783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:05.933958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:05.940320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.940762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.941578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:05.942008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:05.970225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:05.976537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3374467a-ebb5-428e-9159-d7cadd41cbbd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Aug 03 09:47:05.977403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 555/1235] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:05.990809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:05.998329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e64aca87-446f-4b8b-b265-b34766ed9d97 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083176 Aug 03 09:47:05.998914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 681/1236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:06.063201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:06.065367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:06.071752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:06.072202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:06.072997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:06.073435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:06.104252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b67242b-bce3-40f4-b853-4abaafe024ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 03 09:47:06.104828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 556/1237] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:06.989422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:06.991610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:06.998054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:06.998501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:06.999256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:06.999689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:07.019177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:07.019814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:07.027298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:07.027741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:07.028501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:07.028963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:07.029705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b61a118e-8659-4c92-a07d-273c47138221 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 03 09:47:07.030259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 682/1238] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:07.117342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:07.119560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:07.125930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:07.126382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:07.127161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:07.127596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:07.146199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:07.161393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ca984dbc-040e-4579-a912-0ad5e6d2a987 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048683 Aug 03 09:47:07.161989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 683/1239] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:07.285370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:47:07.285622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc (ip 10.222.0.20) !!! Aug 03 09:47:07.331436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:07.339704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-316494c5-8486-414e-9fc6-5ee5efe839e7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.324379 Aug 03 09:47:07.340272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 557/1240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:08.041985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:08.044132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:08.050676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.051127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.051894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.052331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.082682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5b53c0a-3bc8-4602-833e-e54b2250a7db tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Aug 03 09:47:08.083232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 684/1241] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:08.174198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:08.177070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:08.184314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.184768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.185569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.186007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.215830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a259b756-85cd-45d0-ba18-43927d20751c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Aug 03 09:47:08.216391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 558/1242] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:08.360488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:08.361125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:08.367622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.368082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.368851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:08.369282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:08.431713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:08.439162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d130ea69-03c0-4547-9537-b999bf1d25f7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082558 Aug 03 09:47:08.439755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 685/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:09.098172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:09.100947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:09.107050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.107493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.108249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.108682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.138953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9206d96-64fd-48ec-8788-a3977c8c3e0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045984 Aug 03 09:47:09.139502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 559/1244] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:09.228483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:09.230650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:09.237061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.237503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.238251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.238679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.267474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-962e8a26-0abb-4c2e-9f7e-f8f7d78b39d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Aug 03 09:47:09.268015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 686/1245] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:09.461771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:09.462385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:09.468918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.469366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.470124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:09.470559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:09.531503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:09.539010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3da778d2-3f45-42b5-a514-3cff281a54fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081816 Aug 03 09:47:09.539576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 560/1246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:10.151422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:10.153597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:10.159654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.160098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.160882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.161319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.190747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72c4d2f9-9a79-43f4-9b03-ab2e4aaea391 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 Aug 03 09:47:10.191296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 687/1247] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:10.279814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:10.282021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:10.288789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.289248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.290139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.290586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.319686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ed71cad1-8e5f-48cc-9da1-595a686f8ada tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Aug 03 09:47:10.320186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 561/1248] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:10.560027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:10.560644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:10.567046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.567501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.568265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:10.568732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:10.632828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:10.641353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eea8387c-e69b-44a7-9d27-c3167aababc9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085068 Aug 03 09:47:10.642125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 688/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:11.203066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:11.205498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:11.212517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.212997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.213746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.214171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.243224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-44acddbd-6695-456a-b6bc-70409805c112 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Aug 03 09:47:11.243780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 562/1250] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:11.333657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:11.336139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:11.342491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.342942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.343707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.344140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.372993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d25f1099-8436-4741-95b7-a2a94d3f7736 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 03 09:47:11.373541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 689/1251] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:11.664037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:11.664675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:11.670860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.671331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.672083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:11.672511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:11.733438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:11.741672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bceeb909-d887-4110-ac6d-24a7db3ca744 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082207 Aug 03 09:47:11.742249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 563/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:12.255526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:12.258232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:12.264788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.265265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.266022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.266456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.295156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-91dffef1-6390-4067-abc9-f10afb1f179b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Aug 03 09:47:12.295702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 690/1253] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:12.385338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:12.387476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:12.393991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.394439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.395196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.395630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.424697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-49e1c56f-b574-4fe4-9c68-c7d574524b3b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Aug 03 09:47:12.425280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 564/1254] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:12.763104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:12.763630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:12.769626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.770065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.770810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:12.771283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:12.831834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:12.839272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ab0006dd-e80f-4674-a8a0-01429f2281e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080120 Aug 03 09:47:12.839865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 691/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:13.308091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:13.310190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:13.316183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.316629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.317416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.317861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.347426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d84c57f5-3c09-4574-86f3-8fcc87821df3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 Aug 03 09:47:13.347977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 565/1256] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:13.436716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:13.438898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:13.445956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.446410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.447178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.447614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.478004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e0e90a4-1fd8-4780-9d05-32f34a1689a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Aug 03 09:47:13.478557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 692/1257] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:13.859902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:13.860506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:13.867156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.867593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.868340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:13.868764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:13.930118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:13.937554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-18bd759e-efc6-4d48-899a-8ddff81c336f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081527 Aug 03 09:47:13.938126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 566/1258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:14.359615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:14.361795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:14.368404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.368860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:14.369612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.370040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:14.398707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a488f951-4d31-40ef-8293-63231c2799bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Aug 03 09:47:14.399250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 693/1259] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:14.491404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:14.493594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:14.499512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.499951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:14.500692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.501148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:14.528783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-614a7978-907b-44cb-a445-1a8a6c7e07d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Aug 03 09:47:14.529350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 567/1260] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:14.960279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:14.960914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:14.966935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.967379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:14.968134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:14.968568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:15.030166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:15.038592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b356bbd9-92e8-4b77-a6f0-f0f128096904 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083211 Aug 03 09:47:15.039155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 694/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:15.411246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:15.413664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:15.420208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:15.420646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:15.421420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:15.421846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:15.451031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bdde46cf-5d57-40bb-a5a6-c1c97decbb53 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Aug 03 09:47:15.451578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 568/1262] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:15.540968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:15.543102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:15.549600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:15.550060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:15.550819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:15.551257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:15.580881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6def501c-d85c-4af7-a0eb-8aadd89aa198 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Aug 03 09:47:15.581423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 695/1263] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:16.059537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:16.060141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:16.066195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.066639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.067385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.068017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.135856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:16.143613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c43f9556-a101-49b7-a3a0-cbb916d3c697 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087978 Aug 03 09:47:16.144184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 569/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:16.463799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:16.465973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:16.471918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.472375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.473142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.473569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.502322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c8a7b941-4804-4862-b012-7d72851f979d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042503 Aug 03 09:47:16.502867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 696/1265] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:16.593836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:16.595974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:16.603171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.603616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.604371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:16.604804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:16.633684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cf767988-ef81-4cd0-9087-a173e7c88f2b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043820 Aug 03 09:47:16.634242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 570/1266] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:17.165126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:17.165736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:17.172122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.172562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.173345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.173774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.235431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:17.243340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d4df10b8-50c3-408f-8315-c76cc279b0e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082716 Aug 03 09:47:17.243895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 697/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:17.514598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:17.516756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:17.522903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.523348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.524122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.524545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.554008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f1d6f4c5-752c-4bee-8e9a-5d4ad57bddf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043329 Aug 03 09:47:17.554575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 571/1268] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:17.645408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:17.647634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:17.653705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.654130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.654878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:17.655306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:17.685710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-697cebd1-ef76-427e-959d-132dfd5aa195 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044088 Aug 03 09:47:17.686297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 698/1269] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:18.264671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:18.265315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:18.272905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.273350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.274111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.274541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.292698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:18.337771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:18.345755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63efaff5-77ee-4add-8c89-c1408672263e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084936 Aug 03 09:47:18.346314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 572/1270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:18.565689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:18.568645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:18.575100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.575546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.576300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.576734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.605830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e933914c-cb73-4114-a33c-57035dc427fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Aug 03 09:47:18.606388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 699/1271] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:18.698824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:18.701218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:18.707444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.707888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.708676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:18.709209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:18.738958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b82c003-0322-48a5-8334-cda87bbb1130 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 03 09:47:18.740105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 573/1272] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:19.366597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:19.367213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:19.373332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.373780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.374542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.374977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.378896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:19.439456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:19.447658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff992a90-1994-4c51-b853-f7683aca9fc1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085135 Aug 03 09:47:19.448211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 700/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:19.618625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:19.620737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:19.627224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.627665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.628413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.628864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.657799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2bd1bed4-0ab1-4151-aa68-d46f2ea67bd8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Aug 03 09:47:19.658342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 574/1274] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:19.751548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:19.753703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:19.760238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.760701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.761475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:19.761902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:19.790399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee080b2b-0d8d-40ee-bbdf-3f440327ed5f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Aug 03 09:47:19.790937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 701/1275] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:20.468212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:20.468840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:20.475411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.475846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.476590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.477046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.536639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:20.544083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00a2faa6-4ec8-4fdc-8e60-508bab29a073 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079750 Aug 03 09:47:20.544641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 575/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:20.669279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:20.671437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:20.677699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.678153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.678921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.679358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.709110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e119732-3097-48db-9d4d-081f78f4ef38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Aug 03 09:47:20.709666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 702/1277] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:20.803068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:20.805264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:20.811711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.812154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.812947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:20.813384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:20.843271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f21a8473-17ff-4f29-9b7c-9dc2c4d2310d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Aug 03 09:47:20.843817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 576/1278] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:21.565072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:21.565674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:21.567935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=84 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:21.573245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.573715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.574488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.574915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.635623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:21.642957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a8aa3d8-663e-4c79-857e-3004a365098b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081786 Aug 03 09:47:21.643508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 703/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:21.720716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:21.722929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:21.725512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=86 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:21.730818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.731263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.732026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.732457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.761512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b48d431f-9e39-40d8-9945-437b69f24823 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 03 09:47:21.762062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 577/1280] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:21.855556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:21.857722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:21.863779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.864232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.865018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:21.865461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:21.893907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1b981d41-ef83-48ee-b18f-858d31dce47a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 Aug 03 09:47:21.894392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 704/1281] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:22.664485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:22.665107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:22.671483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.671918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.672663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.673114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.735288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:22.743358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-379b04d9-ffba-404e-a02e-c609d63ac7ca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082806 Aug 03 09:47:22.743928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 578/1282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:22.774039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:22.776349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:22.782879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.783321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.784065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.784488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.813772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0886ab54-2a41-4222-91cf-06cf29705e65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 03 09:47:22.814309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 705/1283] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:22.906377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:22.908533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:22.915096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.915481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.916225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:22.916650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:22.951450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8f78d319-b82c-4a1c-98f1-5d63d639d6cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048961 Aug 03 09:47:22.952004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 579/1284] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:23.493140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:47:23.493321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:47:23.764253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:23.764897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:23.771489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.771939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:23.772692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.773155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:23.827065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:23.829238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:23.835319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.835690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:23.835845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:23.836515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.836975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:23.843160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10eb47cb-4d8d-4e26-a6a8-d8eebfcb144b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082757 Aug 03 09:47:23.843726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 706/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:23.866442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7fba7edd-884a-4fca-8251-9b97ea3c626a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Aug 03 09:47:23.866990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 580/1286] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:23.964582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:23.966763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:23.972791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.973271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:23.975654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:23.975654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:24.004190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d831116a-25c2-4b56-8fb8-dfda1506cc79 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 Aug 03 09:47:24.004737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 707/1287] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:24.865559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:24.866178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:24.872700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:24.873169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:24.874014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:24.874444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:24.878796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:24.881927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:24.888384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:24.888894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:24.889659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:24.890092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:24.920565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-79e1c880-cb7b-4b62-8871-86a9a10b3fc6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Aug 03 09:47:24.921169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 708/1288] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:24.938028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:24.946767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e63891d0-83bc-4654-a63f-ae31f7e464d4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085672 Aug 03 09:47:24.947328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 581/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:25.016326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:25.018499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:25.025748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.026195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:25.026950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.027385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:25.057249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7d448f17-5882-4481-af92-82a194fbbb5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Aug 03 09:47:25.057813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 709/1290] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:25.932873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:25.935021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:25.941465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.941902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:25.942694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.943111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:25.967315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:25.967965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:25.972308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1cb4b144-1ef0-4467-b6bd-39d270b2aea0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Aug 03 09:47:25.973064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 582/1291] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:25.975804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.976250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:25.977051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:25.977492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:26.040348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:26.047726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dae044b2-6d42-47d5-b561-89ec1a0f8519 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084195 Aug 03 09:47:26.048290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 710/1292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:26.068627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:26.071121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:26.077502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:26.077953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:26.078717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:26.079180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:26.112040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8a1fc07-ba7f-4ff3-8eaa-b356717f54cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Aug 03 09:47:26.112596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 583/1293] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:26.985334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:26.987492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:26.994743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:26.995183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:26.995931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:26.996359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:27.024218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17dda12d-4769-488e-972f-7952af5109f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Aug 03 09:47:27.024752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 711/1294] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:27.068658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:27.069350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:27.076220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:27.076658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:27.077522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:27.077949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:27.123730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:27.126040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:27.132394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:27.132878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:27.133651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:27.134092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:27.138875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:27.146366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8b0c4fd-4ff6-4593-a48d-117fe1e748e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081604 Aug 03 09:47:27.147170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 584/1295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:27.163957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-27e12005-9780-4ccf-9ac4-f9c985cfdc80 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Aug 03 09:47:27.164506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 712/1296] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:28.036144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:28.038820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:28.044854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.045306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.046066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.046499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.077535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51b93d07-f70d-4f32-88db-bcdee7ff2f8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Aug 03 09:47:28.078138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 585/1297] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:28.167597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:28.168213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:28.174927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.175353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:28.175497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.176271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.176700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.177539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:28.184175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.184622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.185463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:28.185875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:28.215547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-20abe198-1c59-49ef-88c3-85b22f8e5395 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 03 09:47:28.216340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 586/1298] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:28.242935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:28.250394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9182885b-457c-4b20-8ec6-d27b68da0e09 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086747 Aug 03 09:47:28.250952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 713/1299] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:29.090601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:29.092769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:29.099257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.099704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.101367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.101939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.133426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-045b1787-a76b-49f6-98f2-6a99cd9751e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046591 Aug 03 09:47:29.134178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 587/1300] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:29.227671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:29.229877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:29.236269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.236718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.237512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.237950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.267073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-18d9b085-a412-47f0-afb6-a0a89ed509f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Aug 03 09:47:29.267626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 714/1301] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:29.271494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:29.272939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:29.279102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.279545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.280301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:29.280730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:29.342007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:29.349532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-debba317-0d95-4476-aeed-5b75b6cf0bd5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081920 Aug 03 09:47:29.350098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 588/1302] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:30.145844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:30.147962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:30.153927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.154365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.155112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.155553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.184566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-180e9e6e-ef66-445e-86d9-89e44e4e003d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042608 Aug 03 09:47:30.185064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 715/1303] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:30.279226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:30.281464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:30.288517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.289149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.289926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.290358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.294079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:30.319904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5055d616-f4ac-4465-9d77-e5488f3028c8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Aug 03 09:47:30.320736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 589/1304] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:30.370316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:30.371012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:30.377598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.378058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.378816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.379249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.440962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:30.444345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:30.448973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1dabc44b-2568-4eb8-8ce0-4ccffbd45abb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082821 Aug 03 09:47:30.449541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 716/1305] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:30.645627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:30.646125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:30.652343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.652802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.653593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.654032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.668088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 HTTP/1.1 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:47:30.669717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.671139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'c3dcc900-18b4-4f36-911d-e61fc4a9cc58'} Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:47:30.671927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.673823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.677869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:47:30.677869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-14b78d9a-6487-4d0e-8492-17fdaa640674 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 404 len: 111 microversion: 2.1 time: 0.029313 Aug 03 09:47:30.680028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:30.680648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] [instance: c3dcc900-18b4-4f36-911d-e61fc4a9cc58] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:30.686977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.687501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.687739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 590/1306] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:47:30 2022] DELETE /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:47:30.688401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:30.688909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:30.702934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] HTTP exception thrown: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Request method failure captured: Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 HTTP/1.1 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA8AGZZBcghPoETRVSRBRWW0yaSSMkxlE6RfrnHkQF4OlQTRK8uWKLlxf5yHTMNu4LRYjjWN-61aU9HpfNL7kK8w3XPc7GPn_Jpb8ZEqYESltl24QumyRfcFJztdhKFg0lwUX7kpL2ch443oD4yAHZXzS15nzteEP55u7WkTJ_QQPc Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:47:30.704579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_733f2d7dcb854bba87efcf08912c40f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/733f2d7dcb854bba87efcf08912c40f8"}]}] Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 733f2d7dcb854bba87efcf08912c40f8 Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1956186670 Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: a3231c7faed9467e9dad37559ff342ce Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeNegativeTest-1956186670-project Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.706272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'c3dcc900-18b4-4f36-911d-e61fc4a9cc58'} Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:47:30.707235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. Aug 03 09:47:30.708778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:47:30.710196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] Returning 404 to user: Instance c3dcc900-18b4-4f36-911d-e61fc4a9cc58 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:47:30.710196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c8e1a2f2-cee6-41f6-94ee-506182008480 tempest-AttachVolumeNegativeTest-1956186670 tempest-AttachVolumeNegativeTest-1956186670-project] 10.222.0.20 "GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58" status: 404 len: 111 microversion: 2.1 time: 0.030255 Aug 03 09:47:30.710196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 717/1307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:30 2022] GET /compute/v2.1/servers/c3dcc900-18b4-4f36-911d-e61fc4a9cc58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 09:47:31.197143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:31.199410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:31.205331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.205771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.206527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.206957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.238614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dfba404d-fc3b-4df4-aaf0-e63cccf713fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045724 Aug 03 09:47:31.239175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 591/1308] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:31.331778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:31.333945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:31.341136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.341866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.342817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.343493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.376525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-222f470b-4675-40eb-82ad-a5c72da850ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Aug 03 09:47:31.381003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 718/1309] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:31.471166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:31.471831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:31.478491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.478936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.479704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:31.480137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:31.542911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:31.550307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4b85bb4e-0385-4ff5-ac12-879b0b763d11 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083118 Aug 03 09:47:31.550869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 592/1310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:32.251258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:32.253502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:32.260068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.260517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.261303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.261770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.293180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-95521342-4136-4e71-af57-a74e46e68b0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Aug 03 09:47:32.293746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 719/1311] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:32.389197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:32.391345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:32.397299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.398397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.399178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.399592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.429947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8040bedf-b18c-41dc-a7d2-9cfce5996580 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 03 09:47:32.430701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 593/1312] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:32.573602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:32.575274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:32.583833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.584280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.585613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:32.585613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:32.664371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:32.672235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-110e8fcf-7032-4322-b21b-ff23b7d1b362 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.104149 Aug 03 09:47:32.672919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 720/1313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:33.307069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:33.310340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:33.321488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.322174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.322567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.323012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.359051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-17dc5566-5926-44a9-8af1-d6f1c3e1ab94 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057307 Aug 03 09:47:33.364120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 594/1314] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:33.442357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:33.444704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:33.451182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.451713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.452553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.453118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.484543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-44e3200a-6d06-4295-9617-ebdc66f593d5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Aug 03 09:47:33.485254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 721/1315] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:33.694618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:33.695414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:33.701710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.702427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.703441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:33.704112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:33.814650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:33.823432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-13973ebf-bbb7-4050-b46d-8c069948a60e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.133369 Aug 03 09:47:33.829277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 595/1316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:34.371487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:34.374500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:34.380994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.381547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.382981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.383484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.413400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f9d12b0f-75d0-4abd-a72f-8a882bc51c84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045927 Aug 03 09:47:34.413979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 722/1317] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:34.496923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:34.499215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:34.506127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.507131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.507910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.508348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.540515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b23abd9-33d7-445c-8f6d-fff8c2828c50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047969 Aug 03 09:47:34.541126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 596/1318] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:34.844827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:34.845552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:34.851924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.852372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.853162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:34.853596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:34.917534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:34.928309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3f60e24-c4a0-4c0b-98ed-813095827669 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087406 Aug 03 09:47:34.929459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 723/1319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:34 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:35.424674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:35.426815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:35.433908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.434358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:35.435107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.435562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:35.464201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2635c83a-0f48-40ee-8504-7b47afe8a66e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Aug 03 09:47:35.464752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 597/1320] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:35.552306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:35.554806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:35.561324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.561773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:35.562531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.562964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:35.592654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6c8440c7-f452-4509-b0d2-f4496f3114d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Aug 03 09:47:35.593220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 724/1321] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:35.950455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:35.951056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:35.957429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.957864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:35.958611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:35.959030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:36.030472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:36.038291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e876a37f-25f3-48ae-b5b3-20f0a76d3125 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.091585 Aug 03 09:47:36.039001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 598/1322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:36.476885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:36.479257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:36.487456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:36.487896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:36.488659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:36.489142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:36.521480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd32609e-48fb-4046-aec2-ea1ceb6d954d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049377 Aug 03 09:47:36.522069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 725/1323] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:36.606301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:36.608505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:36.615333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:36.615771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:36.617229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:36.617666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:36.653224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f596ac41-0168-416a-a4e0-dfa8f96c34b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051228 Aug 03 09:47:36.653792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 599/1324] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:37.061575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:37.062318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:37.068709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.070100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.070891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.071350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.132921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:37.140415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08a71e3b-cfe6-4a9f-9b0f-aaadac12f641 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082775 Aug 03 09:47:37.140991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 726/1325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:37.533834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:37.535994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:37.543207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.543645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.544389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.544831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.573431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ed05eacc-1e5e-4b24-88a9-4dd0791db9c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 Aug 03 09:47:37.573975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 600/1326] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:37.666051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:37.668240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:37.674862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.675383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.676227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:37.676724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:37.705716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f6a15393-2c82-4b7c-9669-bf4cead3a62e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Aug 03 09:47:37.706246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 727/1327] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:38.161190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:38.161803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:38.168179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.168626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.169424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.169859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.233288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:38.241422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-65f15589-5644-4d6b-95f0-734849495899 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083510 Aug 03 09:47:38.242317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 601/1328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:38.586083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:38.588145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:38.594631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.595080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.595836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.596270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.625521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-610a9e00-1e67-4418-8f0a-deeba3ce4b89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Aug 03 09:47:38.626058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 728/1329] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:38.718381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:38.720507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:38.727714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.728155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.728944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:38.729377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:38.758864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca34a35e-45cf-4e0c-8517-c7437f945d59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Aug 03 09:47:38.759423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 602/1330] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:39.263624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:39.264237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:39.270277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.270717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.271466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.272003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.335166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:39.342723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2420666c-75fc-4cbb-8098-3fe70f197943 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082989 Aug 03 09:47:39.343279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 729/1331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:39.638294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:39.640452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:39.646513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.647611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.648371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.648802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.677235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f7728c0-0735-4191-abfa-673881773090 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042874 Aug 03 09:47:39.677791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 603/1332] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:39.770762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:39.773020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:39.779542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.779995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.780757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:39.781220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:39.809957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a954b1b8-7b53-48d2-973a-71d3851f80e0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Aug 03 09:47:39.810504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 730/1333] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:40.363958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:40.364569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:40.371609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.372054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.372823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.373259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.434251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:40.441708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cda03090-b943-4543-b0e9-91e75cca697d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081675 Aug 03 09:47:40.442273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 604/1334] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:40.690397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:40.692549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:40.698933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.699376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.700129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.700561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.730289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f25d1e5d-1d0a-4f58-8c4f-50c1d9f582ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 03 09:47:40.730829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 731/1335] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:40.822411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:40.824559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:40.830577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.831015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.831760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:40.832186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:40.860666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d874ad7-3489-42ca-9bcd-9e68b02c3c8f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043108 Aug 03 09:47:40.861241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 605/1336] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:41.462671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:41.463286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:41.469790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.470272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.471035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.471473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.535002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:41.543128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-97277fa3-a25a-4344-84f9-3a8c5b04076c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084386 Aug 03 09:47:41.543694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 732/1337] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:41.743178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:41.745256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:41.751633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.752070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.752833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.753305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.769281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:41.781965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b76ade8-9622-468b-895a-fe204cdcd9dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Aug 03 09:47:41.782506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 606/1338] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:41.872856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:41.875004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:41.881284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.882030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.882800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:41.883235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:41.913931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6ce16cb-2a54-41df-a940-8c48355fcf17 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Aug 03 09:47:41.914478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 733/1339] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:42.564655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:42.565291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:42.571923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.572359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.573146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.573569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.635098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:42.642701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db93e040-2b30-4b67-8379-b0c9d32b9ff4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082036 Aug 03 09:47:42.643361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 607/1340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:42.794294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:42.796449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:42.803489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.803936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.804709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.805178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.808911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:42.835155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2963835-ded7-4637-8ced-fdf2e2239819 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Aug 03 09:47:42.835708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 734/1341] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:42.925924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:42.928794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:42.935190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.935628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.936380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:42.936802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:42.966962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9ba1cde6-75c9-4118-8cea-fdb57168520b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 03 09:47:42.967513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 608/1342] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:43.664360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:43.664996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:43.671038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.671479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:43.672232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.672659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:43.734190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:43.741727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e913163-8f62-477c-83fd-9d631271bd54 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082055 Aug 03 09:47:43.742272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 735/1343] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:43.847170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:43.849296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:43.855798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.856240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:43.857017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.857442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:43.886344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-09dd0d6b-7518-4f06-abcf-bed716d56a68 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Aug 03 09:47:43.886887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 609/1344] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:43.979647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:43.981807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:43.988165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.988612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:43.989400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:43.989831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:44.018712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3a9e1d4-8aad-4c6d-884f-762c9047ea4c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 03 09:47:44.019255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 736/1345] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:44.763059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:44.763668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:44.770280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:44.770727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:44.772096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:44.772546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:44.836061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:44.843606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fdaaebad-19e2-4ccc-832c-e574f3b17300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084443 Aug 03 09:47:44.844172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 610/1346] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:44 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:44.898746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:44.900955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:44.907034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:44.907472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:44.908221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:44.908649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:44.937156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96dada28-5235-409f-a543-f2a496994480 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042885 Aug 03 09:47:44.937701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 737/1347] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:45.031116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:45.033243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:45.039346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.039796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.040563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.041038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.076174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca70b32c-62e0-40d2-917f-eed635bbca82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049101 Aug 03 09:47:45.076734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 611/1348] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:45.864366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:45.864897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:45.871089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.871528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.872270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.872697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.932553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:45.939921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ec0f79d1-2bad-4fb2-9144-49dca1eb03bf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079508 Aug 03 09:47:45.940475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 738/1349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:45.949357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:45.951514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:45.957941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.958387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.959867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:45.960302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:45.989563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7865390c-d8ca-4303-8301-141dfac87149 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Aug 03 09:47:45.990161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 612/1350] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:46.088960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:46.091121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:46.097291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:46.097735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:46.098520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:46.098979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:46.128041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a0fe54f-268c-4393-a406-e1860628ded1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Aug 03 09:47:46.128537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 739/1351] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:46.961314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:46.961917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:46.968373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:46.968827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:46.969579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:46.970003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:47.001671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:47.003809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:47.011658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:47.012090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:47.012899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:47.013330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:47.032244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:47.039889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc627b18-a073-4f5c-af43-209803503431 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083010 Aug 03 09:47:47.040463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 613/1352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:47.044140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f7e1781-9541-4a37-a427-db52a0f18917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Aug 03 09:47:47.044709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 740/1353] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:47.140675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:47.142838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:47.149536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:47.149980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:47.150735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:47.151161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:47.179984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9386cd33-000f-48a8-bc23-e374e3b5f048 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043236 Aug 03 09:47:47.180531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 614/1354] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:48.055862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:48.058061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:48.061992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:48.062781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:48.064782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.065266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.066044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.066481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.070103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.070551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.071330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.071792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.096171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a58b0d17-ca20-42a9-a7e4-11af25bb955c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 03 09:47:48.096735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 741/1355] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:48.134016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:48.141442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5cbf4c69-c492-4070-94e8-d733d4b455b5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083272 Aug 03 09:47:48.142002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 615/1356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:48.191506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:48.193998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:48.200336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.200789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.201587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:48.202025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:48.232541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-520d556d-a2da-4297-b97c-84e392fcb004 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Aug 03 09:47:48.233117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 742/1357] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:49.108741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:49.111044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:49.118185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.118624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.119374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.119801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.149023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bfef0350-cb7b-4213-83b5-cb3908035b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Aug 03 09:47:49.149569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 616/1358] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:49.163101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:49.163711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:49.170140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.170589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.171343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.171774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.235764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:49.243669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-386697f0-00aa-4b85-86de-3faa3d5b7953 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084472 Aug 03 09:47:49.243911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:49.244236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 743/1359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:49.246086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:49.252018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.252454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.253229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:49.253655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:49.282790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38e04a88-146d-4606-8914-3709f75593c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Aug 03 09:47:49.283334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 617/1360] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:50.161306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:50.164228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:50.170749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.171197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.171951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.172385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.201934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ad87f390-8a88-4064-b8d4-39c800c37590 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 03 09:47:50.202480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 744/1361] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:50.264068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:50.264671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:50.271696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.272143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.272909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.273338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.295144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:50.297294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:50.303383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.303931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.304695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:50.305148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:50.334974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:50.335158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f3e7f72-d040-41c8-98c7-b5858b03d091 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Aug 03 09:47:50.335689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 745/1362] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:50.342422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e17a336-6ac8-452b-b154-c0869b925036 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082251 Aug 03 09:47:50.342974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 618/1363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:51.214520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:51.216680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:51.223073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.223519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.224612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.225089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.254232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1c304bed-70f7-4080-ae51-17c53b1b6cc0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Aug 03 09:47:51.254783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 746/1364] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:51.347149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:51.349916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:51.356632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.357115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.357878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.358312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.363348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:51.363958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:51.370633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.371158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.371840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:51.372254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:51.388053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2db61ef1-380c-4947-8b5c-8ab04e70c3d7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Aug 03 09:47:51.388623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 619/1365] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:51.432695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:51.440075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-764f65cb-14db-4cc3-a29a-95dfd6d45c44 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080574 Aug 03 09:47:51.440633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 747/1366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:52.267420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:52.269618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:52.271711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=86 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:52.277101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.277544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.278295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.278722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.308459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-703d6ea5-0d06-40b1-a11f-18dc9a1d36a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 03 09:47:52.308970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 620/1367] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:52.400258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:52.402462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:52.404799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=90 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:52.410307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.410758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.411652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.412870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.441385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-226e12f3-81bf-4493-88f8-964476f175a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Aug 03 09:47:52.441938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 748/1368] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:52.461381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:52.462076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:52.468426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.468894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.469646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:52.470068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:52.537554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:52.544955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c037aba-b608-48ff-873c-41730a1afbf6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087917 Aug 03 09:47:52.545516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 621/1369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:53.320098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:53.322197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:53.328249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.328689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.329469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.329898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.359749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-746f9c5a-8a90-407d-bc4c-245374c51e2a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Aug 03 09:47:53.360295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 749/1370] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:53.453741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:53.455897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:53.462705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.463296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.463898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.464333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.494106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-072bf67c-61b4-4e64-857e-63b689447fa9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Aug 03 09:47:53.494655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 622/1371] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:53.565594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:53.566214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:53.573691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.574088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.574852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:53.575287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:53.637201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:53.640544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:53.645332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fe18b4b2-aabc-4ec2-b038-bed1974713cf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083592 Aug 03 09:47:53.646517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 750/1372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:54.372079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:54.374287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:54.380309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.380935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.381713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.382161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.385761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:47:54.410634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4793ae0f-53d0-4ba9-9ac9-ccf9f0f1ab4f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 Aug 03 09:47:54.411175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 623/1373] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:54.506650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:54.508798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:54.514927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.515377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.516134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.516570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.545801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cf260b97-1f4d-4f22-b6c2-95d0564c0946 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Aug 03 09:47:54.546352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 751/1374] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:54.667720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:54.668261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:54.674781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.675222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.675980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:54.676410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:54.738726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:54.746415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-437a644b-d85b-4801-bf3c-a9d5d37dfc36 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082729 Aug 03 09:47:54.746981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 624/1375] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:55.423379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:55.425535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:55.432851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.433300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.434053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.434487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.463932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7bca6dde-48d1-46a0-92a2-ffdaba346e28 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 03 09:47:55.464473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 752/1376] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:55.558646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:55.560779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:55.566804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.567250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.568003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.569624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.598120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2d348b8d-af0d-4b04-9294-dcd212682678 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Aug 03 09:47:55.598668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 625/1377] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:47:55.767646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:55.768202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:55.774279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.774720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.775466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:55.775888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:55.836209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:55.843599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9eb74d9e-f53b-4a6b-9ec2-ed0611460867 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079974 Aug 03 09:47:55.844153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 753/1378] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:56.477031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:56.479155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:56.485624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.486078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.486805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.487227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.516320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f6a24bab-33ff-4ef7-9927-8e7ebd71a57b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 03 09:47:56.516904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 626/1379] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:56.610312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:56.612499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:56.619129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.619574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.620323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.620751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.649963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bbd155a-dd8e-4e29-afdf-f33f6f49940e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Aug 03 09:47:56.650505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 754/1380] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:56.864600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:56.865766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:56.871728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.872171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.873098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:56.873537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:56.934070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:56.941548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-67f22150-1488-467d-b74d-d7ac8e39c404 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080765 Aug 03 09:47:56.942115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 627/1381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:47:57.528598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:57.530788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:57.536856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.538253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:57.539023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.539461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:57.569462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2bfd82e3-4787-42c8-b409-f834c4882b91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Aug 03 09:47:57.570012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 755/1382] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:57.662734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:57.665003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:57.671566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.672008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:57.672761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.673215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:57.701633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-509e32b2-01df-4609-ab35-a7027f0d5a5c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Aug 03 09:47:57.702178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 628/1383] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:57.962678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:57.963323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:57.969813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.970265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:57.971024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:57.971458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:58.035644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:58.043274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c13d4f33-52ba-406d-9023-1188e83c2830 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084969 Aug 03 09:47:58.043843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 756/1384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:58.581628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:58.583817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:58.589917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:58.590356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:58.591102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:58.591525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:58.619661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07595537-6137-40b8-9d19-d0a35d130131 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Aug 03 09:47:58.620208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 629/1385] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:58.714239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:58.716360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:58.722470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:58.722910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:58.723660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:58.724089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:58.752644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e2d4499-cdef-46bf-a3e6-2871186aba7c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042495 Aug 03 09:47:58.753208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 757/1386] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:47:59.064978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:59.065586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:59.072301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.072743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.073550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.073990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.143021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:47:59.151080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-649e120c-c106-46b1-a254-213282c2e207 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.090062 Aug 03 09:47:59.151643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 630/1387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:47:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:47:59.632578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:47:59.634791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:59.641267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.641711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.642455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.642907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.723066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-943c44b6-a2b6-4fcd-bd3a-becd6bc4af0d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action" status: 200 len: 76173 microversion: 2.1 time: 0.094811 Aug 03 09:47:59.723892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 758/1388] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:47:59 2022] POST /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd/action => generated 76173 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 03 09:47:59.765448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:47:59.767588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:47:59.773699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.774139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.774886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:47:59.775339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:47:59.805333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61b6e3e6-8bf2-453e-8a83-508ea46e2813 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Aug 03 09:47:59.805874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 631/1389] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:47:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:00.173527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:00.174252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:00.182125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:00.182575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:00.183331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:00.183757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:00.246133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:00.253486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-59e13ba1-9033-4f1c-95ec-ad42b0264bd9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084285 Aug 03 09:48:00.254035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 759/1390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:00.817414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:00.820830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:00.827243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:00.827688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:00.828447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:00.828932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:00.858606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b31a00b-794e-409f-823f-fa8f7658b8ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 03 09:48:00.859171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 632/1391] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:01.275090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:01.275642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:01.282187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:01.282639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:01.283403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:01.283844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:01.350792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:01.358297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9a95417b-db4d-4a8d-8ee4-ecc6f5dc4773 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087399 Aug 03 09:48:01.358866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 760/1392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:01.870708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:01.872900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:01.879422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:01.879862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:01.881181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:01.881801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:01.910798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3b94aeb-485c-4e09-9276-5e4e1c0aa531 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 03 09:48:01.911341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 633/1393] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:02.379387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:02.380020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:02.387230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:02.387669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:02.388417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:02.388865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:02.449952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:02.457299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e4a729a-8c56-4113-ab39-ddcedd761b28 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081748 Aug 03 09:48:02.457848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 761/1394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:02.923188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:02.925265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:02.931726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:02.932169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:02.932959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:02.933389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:02.962366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-39b39ae3-55df-454b-95a2-f32d0a1b3ed3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043273 Aug 03 09:48:02.962919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 634/1395] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:03.477741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:03.478349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:03.484778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:03.485260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:03.486006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:03.486536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:03.554689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:03.562179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4970b7b-d386-4c39-8ff1-f3da05d2f818 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088523 Aug 03 09:48:03.562748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 762/1396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:03.975116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:03.977454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:03.983836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:03.984275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:03.985053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:03.985507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:04.014781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d490d8df-6a5c-4963-b666-7782ba777f19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 03 09:48:04.015330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 635/1397] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:04.583219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:04.584517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:04.591174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:04.591609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:04.592353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:04.592775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:04.652601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:04.659992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-524ef75a-cd77-403c-bf0a-85522adfdb2b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080595 Aug 03 09:48:04.660549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 763/1398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:05.027416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:05.029560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:05.035905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:05.036903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:05.037767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:05.038196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:05.067956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f35c4e2-c19e-4644-96d6-c299fdec1f8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 Aug 03 09:48:05.068519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 636/1399] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:05.681439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:05.682053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:05.688562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:05.689048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:05.689808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:05.690249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:05.751777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:05.759799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c04b67d5-4940-4666-9f25-1ad747df8716 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082268 Aug 03 09:48:05.760364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 764/1400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:06.079694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:06.082137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:06.088800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:06.089270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:06.090285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:06.090716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:06.120856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9f6b2bb-ddd7-45bf-aa41-b51c8b4db502 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044826 Aug 03 09:48:06.121951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 637/1401] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:06.781141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:06.781748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:06.788370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:06.788752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:06.789537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:06.789967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:06.850806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:06.858326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7387fbcf-09d8-4e52-b78c-a019505f682d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081081 Aug 03 09:48:06.858884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 765/1402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:07.134277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:07.136428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:07.143163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:07.143614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:07.144376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:07.145165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:07.175342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4932ee74-8daa-42c2-8834-ff9346e3bc07 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 03 09:48:07.175900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 638/1403] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:07.882081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:07.882696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:07.889630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:07.890075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:07.890839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:07.891266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:07.955767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:07.964042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-576b8577-94ea-4581-bd3a-1ad92fa0415c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088146 Aug 03 09:48:07.964604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 766/1404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:08.187933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:08.190126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:08.197756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:08.198203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:08.198969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:08.199405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:08.223780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:08.228876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-906c1453-56da-4d1c-abae-b2631de727b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Aug 03 09:48:08.229441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 639/1405] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:08.984995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:08.985571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:08.992509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:08.992989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:08.993744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:08.994195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:09.055951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:09.059438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:09.064374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c379bb5-8b6f-4f73-b2e3-1e40f969c984 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083239 Aug 03 09:48:09.064960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 767/1406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:09.241515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:09.243560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:09.250098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:09.250544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:09.251299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:09.251728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:09.281571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b611f38-ce0a-47b2-8846-c2e25e1a0263 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Aug 03 09:48:09.282122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 640/1407] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:10.086460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:10.087067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:10.093666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:10.094109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:10.094858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:10.095287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:10.155653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:10.164361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5b5dd7be-aed1-410e-8da3-c0ac96344233 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081792 Aug 03 09:48:10.164950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 768/1408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:10.293762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:10.295814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:10.302861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:10.303309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:10.304091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:10.304518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:10.333727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c73f4232-d063-4d3f-9e61-c60b0852665a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Aug 03 09:48:10.334288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 641/1409] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:11.185786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:11.186392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:11.193439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:11.194135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:11.194887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:11.195315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:11.259822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:11.267296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4633b19-e31c-4e17-a0c8-6b90d5427896 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085361 Aug 03 09:48:11.267861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 769/1410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:11.345756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:11.347916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:11.354599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:11.355037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:11.355812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:11.356236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:11.385376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-627f17c0-5b7b-4cff-9c8b-7bf493d95094 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043472 Aug 03 09:48:11.385860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 642/1411] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:12.288879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:12.289490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:12.295859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:12.296303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:12.297082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:12.297514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:12.360552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:12.368482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a0f28f4b-eac1-43ee-ae74-f3984ae5a04c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084146 Aug 03 09:48:12.369069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 770/1412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:12.397088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:12.399212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:12.405675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:12.406115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:12.406865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:12.407289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:12.437147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08a8e02b-0829-49e9-9362-0254ad2e461c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043988 Aug 03 09:48:12.437710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 643/1413] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:13.389436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:13.390080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:13.396570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:13.397040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:13.397791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:13.398219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:13.449983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:13.452154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:13.458867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:13.459317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:13.459445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:13.460083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:13.460512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:13.466861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e45713ce-94e3-49ad-a3f4-057c15e0424f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081281 Aug 03 09:48:13.467434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 771/1414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:13.490004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc4b9fe6-12c6-4152-8b26-fa0f84cc78f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043434 Aug 03 09:48:13.490683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 644/1415] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:14.487825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:14.488457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:14.495095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:14.495568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:14.496313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:14.496740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:14.502110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:14.504292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:14.511207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:14.511655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:14.512410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:14.512852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:14.542889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00847db2-9e24-43c1-9f00-2c8e1d6f52ab tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044560 Aug 03 09:48:14.543651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 645/1416] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:14.558023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:14.565473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2a4c6388-8ee9-4769-8f6d-45a6b57b53a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081525 Aug 03 09:48:14.566020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 772/1417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:15.555803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:15.557993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:15.564420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:15.564898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:15.565655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:15.566085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:15.587327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:15.588027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:15.594521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:15.594962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:15.595089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eac1904c-c7d8-4d94-83bb-f91fef7d476a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 03 09:48:15.595638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 646/1418] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:15.595801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:15.596134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:15.659230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:15.667524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b791cd67-a8b3-4f0f-9911-e18bec02fe79 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084221 Aug 03 09:48:15.668097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 773/1419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:48:16.607824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:16.610007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:16.617115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:16.617559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:16.618304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:16.618730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:16.648145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61189198-bbca-4aa1-9466-b95fd1a9655b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044241 Aug 03 09:48:16.648691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 647/1420] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:16.688444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:16.689110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:16.695860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:16.696306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:16.697114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:16.697548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:16.761165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:16.768605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c482ce1c-ccd9-4698-a3dc-66f462e748c5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084029 Aug 03 09:48:16.769192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 774/1421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:17.660247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:17.662673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:17.669130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:17.669571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:17.670324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:17.670751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:17.699787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-039e67cb-ee4d-4455-a20e-194e58901f91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043482 Aug 03 09:48:17.700328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 648/1422] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:17.790288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:17.790899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:17.797445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:17.797885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:17.798631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:17.799072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:17.859554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:17.867513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2871239-36a2-4bd4-8811-62015ee435e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081115 Aug 03 09:48:17.868064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 775/1423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:18.712663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:18.714885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:18.721476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:18.721921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:18.722674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:18.723756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:18.752510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3691219-4471-4928-985d-dc02cb9aab3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 03 09:48:18.753092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 649/1424] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:18.888456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:18.889098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:18.895886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:18.896352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:18.897128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:18.897563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:18.961654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:18.969099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fc7d0043-ce18-4852-90cc-b0cb99781f71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084507 Aug 03 09:48:18.969594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 776/1425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:19.765448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:19.767586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:19.774781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:19.775230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:19.775985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:19.776419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:19.804348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bfdbc9f6-5215-4266-afd0-f4e185f8aaa1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Aug 03 09:48:19.804907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 650/1426] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:19.990122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:19.990743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:19.997327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:19.997778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:19.998539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:19.998979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:20.059747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:20.067815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e16823e9-9992-4b96-b1ff-d323769a6d1b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081880 Aug 03 09:48:20.068631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 777/1427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:20.816484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:20.819548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:20.826011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:20.826451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:20.827198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:20.827624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:20.856309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93f5cf59-645b-4163-a8c0-d489d06e7f4b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Aug 03 09:48:20.856862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 651/1428] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:21.089280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:21.089823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:21.096259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:21.096702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:21.097494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:21.097960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:21.162292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:21.169823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8b21ce08-f5f5-43cf-8a06-895f27ef88ac tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084489 Aug 03 09:48:21.170387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 778/1429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:21.869324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:21.871462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:21.878022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:21.878469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:21.879947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:21.880649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:21.909703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f1098b5-4e02-4176-a436-9b8dd0320daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Aug 03 09:48:21.910251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 652/1430] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:22.191242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:22.192030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:22.198814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:22.199280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:22.200033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:22.200477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:22.261733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:22.269430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-723ba91a-e7f0-424e-a562-3e0d4603118e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082144 Aug 03 09:48:22.270161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 779/1431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:22.922395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:22.924534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:22.927169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=66 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:22.932426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:22.932926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:22.933684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:22.934113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:22.964393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7dd26912-3cff-418e-b512-5e122962bad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 03 09:48:22.964966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 653/1432] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:23.290612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:23.291131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:23.293417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=64 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:23.298936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:23.299379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:23.300129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:23.300559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:23.363138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:23.371679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12034129-92fb-4c2e-8b88-21dc8d4c5269 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084987 Aug 03 09:48:23.372245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 780/1433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:48:23.977882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:23.980174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:23.986913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:23.987727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:23.988583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:23.989051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:24.020890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0288a800-96a8-4e00-a386-6607e4133d84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047883 Aug 03 09:48:24.021458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 654/1434] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:24.393209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:24.393822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:24.401076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:24.401527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:24.402285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:24.402725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:24.464412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:24.471890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-73c3da74-890d-43be-ab42-0c8a65a7e0d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082602 Aug 03 09:48:24.472458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 781/1435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:25.033943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:25.036601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:25.043026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:25.043462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:25.044208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:25.044635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:25.075718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-336f7a9d-9cb5-4ef4-bc68-2ec31100c962 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 03 09:48:25.076282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 655/1436] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:25.493027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:25.493631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:25.500022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:25.500461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:25.501237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:25.501662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:25.565374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:25.573190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-68be62a8-4822-43c9-878d-f5de91a5990a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084030 Aug 03 09:48:25.573745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 782/1437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:26.089200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:26.091336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:26.097916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:26.098375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:26.099139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:26.099575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:26.117650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:26.131706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a98688da-7d22-424e-8f1e-d2bb44453363 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046555 Aug 03 09:48:26.132277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 656/1438] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:26.594671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:26.595275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:26.602449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:26.602889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:26.603655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:26.604084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:26.668149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:26.675581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-97b2ed23-5413-4a7b-8409-7c24a137839e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084750 Aug 03 09:48:26.676183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 783/1439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:27.143669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:27.146869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:27.153669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:27.154135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:27.154948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:27.155405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:27.184285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3b1784c-790c-4f34-a0dc-e5e02f3911c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 03 09:48:27.184872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 657/1440] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:27.697613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:27.698221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:27.704656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:27.705124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:27.705875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:27.706300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:27.724417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:27.768904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:27.776444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7d0e8928-1d5d-4102-b3ae-1e1b7f511280 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082979 Aug 03 09:48:27.777041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 784/1441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:28.197087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:28.199233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:28.205784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:28.206234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:28.207129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:28.207568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:28.236737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f00eb27a-8fe0-4b98-b41f-e3e9af047fe1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Aug 03 09:48:28.237334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 658/1442] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:28.797568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:28.798183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:28.804727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:28.805201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:28.805942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:28.806375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:28.867392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:28.874810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1e46b8e6-49d4-4d58-86aa-9d0ece67748b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081080 Aug 03 09:48:28.875371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 785/1443] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:29.254796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:29.256972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:29.263610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:29.264059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:29.264835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:29.265273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:29.299504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-33a9267f-4943-4543-b5d7-8603f4e9a312 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049340 Aug 03 09:48:29.300066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 659/1444] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:30.100935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:30.101551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:30.107508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:30.107954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:30.108699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:30.109150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:30.172070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:30.180643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-da9abd7b-2fa7-4e7b-8757-200ca156f902 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.288413 Aug 03 09:48:30.181248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 786/1445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:30.311583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:30.313752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:30.320712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:30.321188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:30.321945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:30.322378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:30.351439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21ecd82e-ea5a-4f9f-a229-c6293d71e2bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Aug 03 09:48:30.351992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 660/1446] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:31.202535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:31.203142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:31.210574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:31.211019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:31.211780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:31.212211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:31.273254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:31.284438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a38e457-2c30-41e9-ba74-75918b0cd345 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085772 Aug 03 09:48:31.285134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 787/1447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:31.363517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:31.365710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:31.372004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:31.372444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:31.373219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:31.373646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:31.402872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-62ef5b11-7739-4bc5-b7e0-88b4a5db1ebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Aug 03 09:48:31.403416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 661/1448] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:32.304981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:32.305647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:32.312122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:32.312589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:32.313367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:32.313799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:32.375043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:32.382631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea82a84b-4743-42e8-b403-31d3800cd2ea tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081931 Aug 03 09:48:32.383193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 788/1449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:32.415673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:32.417844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:32.424265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:32.424713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:32.425527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:32.426149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:32.454935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e4d08e8-f407-482b-834c-11dce0d8fee2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Aug 03 09:48:32.455484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 662/1450] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:33.404213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:33.404838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:33.411920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:33.412362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:33.413370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:33.414114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:33.467545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:33.469715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:33.477327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:33.477626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:33.477756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:33.478518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:33.478947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:33.485150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17ce09fb-d5fa-43f9-a691-f9f86082ff95 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084749 Aug 03 09:48:33.485713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 789/1451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:33.508394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-89c93297-9995-48fd-8409-6d9205d60ca0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 03 09:48:33.508970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 663/1452] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:34.507768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:34.508371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:34.515008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:34.515472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:34.516227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:34.516654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:34.520244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:34.522724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:34.529117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:34.529567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:34.530333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:34.530770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:34.561631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df74816d-07c8-419a-8fa6-a61e54cc03ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Aug 03 09:48:34.562216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 664/1453] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:34.583181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:34.590804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0742b8cd-331e-4976-810d-4a7a7c16262c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087565 Aug 03 09:48:34.591360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 790/1454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:34 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:35.574122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:35.576491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:35.583210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:35.583654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:35.584407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:35.584848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:35.612034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:35.613407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:35.619422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:35.619867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:35.620875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:35.621549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:35.626663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-290f997f-d06a-4d95-b1b2-066bb6a07c8c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055217 Aug 03 09:48:35.626663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 665/1455] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:35.684662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:35.693294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8deb8fae-b5f3-443a-903e-71adab0ef9d0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085344 Aug 03 09:48:35.693865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 791/1456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:48:36.637868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:36.640019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:36.647593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:36.648043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:36.648840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:36.649269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:36.679289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a1ae3a9-6732-4675-92db-a88a3d790626 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Aug 03 09:48:36.679843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 666/1457] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:36.713923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:36.714559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:36.721104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:36.721547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:36.722950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:36.723390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:36.783478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:36.792078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d51a7eda-9a48-4fa1-aaa6-1c08b3bbd889 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081841 Aug 03 09:48:36.792582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 792/1458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:37.691578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:37.694139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:37.700587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:37.701062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:37.701823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:37.702255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:37.732866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e16e5597-0ac4-40fb-9a17-504f9a7dd19b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Aug 03 09:48:37.733444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 667/1459] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:37.812497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:37.813128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:37.820394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:37.820860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:37.821616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:37.822041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:37.883529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:37.890916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5c9feb1c-6a38-48e2-8af7-9ec3319e744b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082215 Aug 03 09:48:37.891665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 793/1460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:38.745490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:38.747622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:38.754599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:38.755037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:38.755789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:38.756219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:38.784912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5ab4a8dd-bb8c-4739-b5ec-7402fde456cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042793 Aug 03 09:48:38.785465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 668/1461] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:38.912774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:38.913427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:38.919877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:38.920322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:38.921106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:38.921547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:38.985870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:38.993590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-939485c0-78c8-437d-a033-0c48ffd2b075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085267 Aug 03 09:48:38.994161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 794/1462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:39.797122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:39.799240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:39.806278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:39.806713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:39.807456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:39.807877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:39.836960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-601812ce-2ae2-4b19-935e-d7d3aad22830 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Aug 03 09:48:39.837513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 669/1463] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:40.015037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:40.015647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:40.023464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:40.023919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:40.024683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:40.025146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:40.086432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:40.093941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-98e9ecee-8c4a-485e-8d72-6266159ce5ba tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082742 Aug 03 09:48:40.094541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 795/1464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:40.849157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:40.851332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:40.857936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:40.858384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:40.859145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:40.859576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:40.888305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2aa36abd-2453-48bc-bf3e-d99dc797f15d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Aug 03 09:48:40.888865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 670/1465] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:41.115381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:41.115928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:41.122420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:41.122868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:41.123624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:41.124061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:41.185709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:41.193998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c961a8d-20bb-4aad-8231-219da155fdb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083557 Aug 03 09:48:41.194559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 796/1466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:41.900680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:41.902842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:41.909878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:41.910490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:41.911244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:41.911673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:41.939503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-022c68f8-4841-43e9-8cf1-7516592b13c4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042751 Aug 03 09:48:41.940049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 671/1467] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:42.215078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:42.215617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:42.223133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:42.223585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:42.224455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:42.224929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:42.287460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:42.294893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7dbf947e-5db6-4dfd-9d50-cbc62c8920f6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083806 Aug 03 09:48:42.295446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 797/1468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:42.952112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:42.954287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:42.960797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:42.961271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:42.962027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:42.962457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:42.990989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca0b1821-c84a-4680-968b-21662749fcd5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042891 Aug 03 09:48:42.991537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 672/1469] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:43.315664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:43.316266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:43.323235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:43.323694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:43.324472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:43.325091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:43.430643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:43.438148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-03d7e8cd-93c1-4227-a77f-e5de9e547b9b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.126492 Aug 03 09:48:43.438723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 798/1470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:44.003938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:44.006143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:44.012719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:44.013203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:44.013970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:44.014403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:44.018131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:44.047815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9a09ae2-e990-4142-897b-075a7fd0484f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048409 Aug 03 09:48:44.048405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 673/1471] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:44.460264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:44.460897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:44.467071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:44.467517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:44.468265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:44.468695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:44.529633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:44.537084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2fe8c242-a6dd-452d-977b-758db5346096 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081364 Aug 03 09:48:44.537656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 799/1472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:44 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:45.061185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:45.063360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:45.070999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:45.071450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:45.072215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:45.072649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:45.100930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7947be7d-4214-424a-8d73-771fcba65f83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Aug 03 09:48:45.101485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 674/1473] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:45.557036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:45.557652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:45.564166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:45.564610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:45.566981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:45.567433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:45.629481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:45.637006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fe58628d-90a0-4cdb-a588-85f908ab3169 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083852 Aug 03 09:48:45.637562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 800/1474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:46.113218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:46.115372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:46.122096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:46.122535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:46.123283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:46.123707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:46.155849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-58cbe02c-b4ed-4b35-b1a6-c884432b78a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Aug 03 09:48:46.156406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 675/1475] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:46.658638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:46.659845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:46.666294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:46.666736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:46.667486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:46.667912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:46.671841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:46.729241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:46.736658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9dece1f2-0be7-443c-8e2e-a2fd7a2186c1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081920 Aug 03 09:48:46.737459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 801/1476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:47.168418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:47.170922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:47.178024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:47.178464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:47.179216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:47.179642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:47.209353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a02e25b-9f33-4ee4-b756-fdbbd1f607a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 03 09:48:47.209896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 676/1477] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:47.758157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:47.758765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:47.765191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:47.765634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:47.766383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:47.766808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:47.829975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:47.838021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1410de1e-85fa-4706-a2b2-be3756b36364 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083748 Aug 03 09:48:47.838580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 802/1478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:48.221444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:48.223662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:48.230090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:48.230630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:48.231383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:48.231807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:48.262717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1dbeb7af-a191-494b-93b6-bccce05bc482 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Aug 03 09:48:48.263280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 677/1479] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:48.858776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:48.859381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:48.866326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:48.866762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:48.867506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:48.867933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:48.928271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:48.935709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9ddc7574-94ac-4b7d-be21-351ffe282037 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080769 Aug 03 09:48:48.936277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 803/1480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:49.275124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:49.277294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:49.284265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:49.284718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:49.285493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:49.285920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:49.314893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-58e61d0d-d849-4054-ad2e-6e4729a5e906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043832 Aug 03 09:48:49.315867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 678/1481] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:49.958457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:49.959076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:49.965586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:49.966038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:49.966798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:49.967237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:50.029563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:50.037082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3ad4bbeb-667a-4abf-bcc4-75afe20bfa25 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083164 Aug 03 09:48:50.037644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 804/1482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:50.327817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:50.329920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:50.336661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:50.337128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:50.337877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:50.338299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:50.367746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1bba68cb-fa8e-447e-b9d6-4d64daf10877 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043954 Aug 03 09:48:50.368301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 679/1483] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:51.057820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:51.058436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:51.064966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:51.065408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:51.066774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:51.067384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:51.131882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:51.139815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cfaac5ab-08b9-4900-8d27-733446f5f482 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085880 Aug 03 09:48:51.140381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 805/1484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:51.380912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:51.383080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:51.389494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:51.389942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:51.390759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:51.391191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:51.420961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe4b3b94-51e1-45a4-b4dc-52aa4ca24066 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Aug 03 09:48:51.421515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 680/1485] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:52.161852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:52.162575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:52.169053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:52.169618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:52.170383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:52.170811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:52.235617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:52.243658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-154403a7-8b3a-45b9-b650-fafc7dbc1561 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086155 Aug 03 09:48:52.244222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 806/1486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:52.433445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:52.435622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:52.442176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:52.442868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:52.443623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:52.444047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:52.473339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7f52704a-eeea-42ec-bfe8-28a96c096ee8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Aug 03 09:48:52.473884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 681/1487] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:53.264892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:53.265505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:53.272736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:53.273210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:53.273963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:53.274413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:53.335691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:53.343159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-84f6fda6-0853-49d1-b815-a0ef637ab2b9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082249 Aug 03 09:48:53.343717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 807/1488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:53.484869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:53.486997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:53.489962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=58 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:53.495141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:53.495589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:53.496339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:53.496770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:53.526151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6d929a38-a498-4386-bbb6-6aed869e09ff tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045278 Aug 03 09:48:53.526699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 682/1489] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:54.363678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:54.364284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:54.366612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=56 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:48:54.371868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:54.372309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:54.373096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:54.373531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:54.433521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:54.441544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f675ca41-99e9-4b79-96cb-6f12e4f615c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081091 Aug 03 09:48:54.442104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 808/1490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:54.539067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:54.541272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:54.547700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:54.548138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:54.548906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:54.549333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:54.578486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bcaf6e87-cfb3-4a7b-a037-712b427fccc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Aug 03 09:48:54.579051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 683/1491] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:55.059753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:48:55.059974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:48:55.462563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:55.463225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:55.469651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:55.470092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:55.470838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:55.471264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:55.534067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:55.541684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0676d02a-0edd-431b-8714-ea54e848f44b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082974 Aug 03 09:48:55.542241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 809/1492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:55.591504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:55.593733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:55.600143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:55.600590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:55.601395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:55.601825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:55.634153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84058008-c2c2-4a7f-9305-850bc953be7a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 03 09:48:55.634711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 684/1493] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:56.562483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:56.563093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:56.570643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:56.571084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:56.571826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:56.572252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:56.635013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:56.642362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40e0d417-b8c5-45ef-9ced-2e341e5a57d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083740 Aug 03 09:48:56.642908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 810/1494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:56.647444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:56.649614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:56.655698 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:56.656144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:56.656938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:56.657371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:56.686133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84583491-900d-474a-b8a1-7790932bc75b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Aug 03 09:48:56.686679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 685/1495] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:57.664176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:57.664790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:57.671367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:57.671809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:57.672589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:57.673049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:57.699138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:57.701363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:57.708116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:57.708590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:57.709408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:57.709839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:57.736115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:57.740532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b1bb9d45-a4d9-42d6-9284-3c103ad0b4d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045266 Aug 03 09:48:57.741129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 686/1496] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:48:57.744137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e978555e-2895-48b7-87c7-9bc1d52dede6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083815 Aug 03 09:48:57.744700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 811/1497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:48:58.752765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:58.755634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:58.762113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:58.762555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:58.763307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:58.763734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:58.765597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:58.766401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:58.773058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:58.773500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:58.774255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:58.774683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:58.793491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9ea1b033-47b9-475d-9b58-d2403ef310f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044623 Aug 03 09:48:58.794042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 687/1498] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:58.835082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:58.842439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cf91be6c-07f1-4d8a-8ccc-9f749b17518b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080910 Aug 03 09:48:58.842997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 812/1499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:48:59.805882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:59.808048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:59.814546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:59.814988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:59.816398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:59.816931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:59.845899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c763bb4d-1b1e-45cf-8a1f-bc7778bb5b84 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Aug 03 09:48:59.846375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 688/1500] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:48:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:48:59.863956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:48:59.864559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:48:59.871081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:59.871520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:59.872266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:48:59.872693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:48:59.935404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:48:59.944508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c305aef4-4367-44cf-9ce9-af39c7df4f9d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084916 Aug 03 09:48:59.946183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 813/1501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:48:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:00.575410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:49:00.575638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:49:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:49:00.858569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:00.860692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:00.867548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:00.867994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:00.868752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:00.869208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:00.894789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:00.899908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-37e77e99-c5da-4eba-84ca-3f2999f39041 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 03 09:49:00.900471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 689/1502] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:00.966374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:00.967086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:00.974542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:00.974994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:00.975757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:00.976192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:01.044718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:01.049789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1721301f-1866-452c-8da5-2929f595c723 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087229 Aug 03 09:49:01.050411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 814/1503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:01.912858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:01.915004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:01.921392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:01.921831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:01.922576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:01.923004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:01.951777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2fbe8eea-f672-4639-bbfd-0d5d9e88a150 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 03 09:49:01.952318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 690/1504] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:02.071649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:02.072259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:02.078761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:02.079200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:02.079950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:02.080380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:02.142218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:02.149780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1355a1c0-1ce2-4917-964c-e537adb083d5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082274 Aug 03 09:49:02.150325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 815/1505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:02.964308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:02.966546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:02.973715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:02.974162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:02.974957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:02.975392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:03.004697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4dcb92af-d96e-46b6-b563-e19db6267505 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Aug 03 09:49:03.005273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 691/1506] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:03.170471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:03.171108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:03.177648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:03.178089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:03.178833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:03.179260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:03.240214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:03.247667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d71d2518-92fb-43e9-9adf-00505d058b41 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081023 Aug 03 09:49:03.248214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 816/1507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:04.016478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:04.018589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:04.025050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:04.025499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:04.026253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:04.026682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:04.056689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d4b367b8-4fde-43cd-82cf-db5704a38dcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Aug 03 09:49:04.057300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 692/1508] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:04.269141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:04.269681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:04.276168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:04.276613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:04.277411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:04.277848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:04.340015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:04.343404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:04.349159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d85a24a6-67f6-470d-96b9-ddf568e9a61c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084241 Aug 03 09:49:04.349716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 817/1509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:05.070513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:05.072637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:05.078649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:05.079118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:05.079875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:05.080307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:05.109606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-589daf69-b49e-4956-a8b8-92d89b8ca30f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 Aug 03 09:49:05.110163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 693/1510] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:05.370035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:05.370648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:05.377352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:05.378490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:05.379255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:05.379690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:05.446730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:05.454333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0884ec70-191f-46bb-baa7-b5e6b25fd894 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088158 Aug 03 09:49:05.454895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 818/1511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:06.121802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:06.123936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:06.132145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:06.132434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:06.133214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:06.133647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:06.163321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50949a34-09bc-49a4-9720-7d5ba8a07643 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Aug 03 09:49:06.163877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 694/1512] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:06.475074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:06.475750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:06.482122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:06.482560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:06.483308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:06.483734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:06.544550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:06.552087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32909772-32bf-49c0-867a-f937062c4d8f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080894 Aug 03 09:49:06.552647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 819/1513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:07.176217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:07.178426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:07.184837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:07.185287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:07.186030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:07.186455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:07.215057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f10ffb12-d895-486b-a373-cc4e75cda73f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Aug 03 09:49:07.215626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 695/1514] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:07.573473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:07.574102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:07.581165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:07.581656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:07.582420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:07.582858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:07.642717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:07.650662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-813662fc-d9d1-4d73-a51e-af7386315962 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081059 Aug 03 09:49:07.651230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 820/1515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:08.227364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:08.229527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:08.235998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:08.236442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:08.237761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:08.238189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:08.267421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-57977fa1-938f-4388-9f96-c108e330d65a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044082 Aug 03 09:49:08.268167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 696/1516] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:08.672229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:08.672868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:08.680130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:08.680584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:08.681374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:08.681815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:08.743493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:08.750968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f48b11c2-6ef2-4db8-8499-6225533f20a4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082649 Aug 03 09:49:08.751525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 821/1517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:09.279601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:09.281798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:09.289215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:09.289662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:09.290419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:09.290850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:09.320156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d09e7c7f-aa3c-452b-8ec1-c43e8e592345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Aug 03 09:49:09.320632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 697/1518] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:09.773111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:09.773730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:09.780205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:09.780657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:09.781451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:09.781886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:09.846236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:09.853660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a77b3581-56b4-4e10-bc38-930d1864ad6a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084577 Aug 03 09:49:09.854224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 822/1519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:10.332288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:10.334365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:10.340780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:10.341257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:10.342018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:10.342477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:10.371120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d2048d2f-028a-4509-ae1c-9bfba61432cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 03 09:49:10.371671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 698/1520] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:10.874997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:10.875641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:10.882684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:10.883132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:10.883891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:10.884326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:10.945448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:10.952863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-79ffc66e-679f-4f64-9613-0597b91d7dca tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081773 Aug 03 09:49:10.953423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 823/1521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:11.384075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:11.386227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:11.392704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:11.393286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:11.394188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:11.394617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:11.422480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-52e257b1-2118-4ac4-a69c-2b9761148ce7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042418 Aug 03 09:49:11.423022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 699/1522] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:11.974983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:11.975592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:11.982117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:11.982555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:11.983297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:11.983724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:12.043561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:12.051027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4184c959-1ad2-435e-84bc-1eb8295189a6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080579 Aug 03 09:49:12.051586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 824/1523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:12.435432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:12.437615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:12.445082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:12.445521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:12.446271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:12.446697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:12.475899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be9a2776-5906-4056-8901-5ee779214e0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 03 09:49:12.476443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 700/1524] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:13.072644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:13.073284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:13.079714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:13.080157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:13.081624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:13.082057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:13.145495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:13.152953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7c329bf-2481-41de-90a2-626ff5e07ac6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084215 Aug 03 09:49:13.153517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 825/1525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:13.488222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:13.490360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:13.496873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:13.497318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:13.498071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:13.498507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:13.527840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a4af8d0f-45a7-4aa9-9408-a9f789bfd6a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043598 Aug 03 09:49:13.528385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 701/1526] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:14.176212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:14.176881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:14.182962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:14.183410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:14.184166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:14.184595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:14.248505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:14.256953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2895dadf-92bf-42e7-8f69-a5e4d61336bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085899 Aug 03 09:49:14.257522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 826/1527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:14.540428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:14.542599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:14.550462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:14.550906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:14.551655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:14.552082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:14.580316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8bf11035-c758-4ca8-8d63-a7b4347d0045 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Aug 03 09:49:14.580882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 702/1528] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:15.277236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:15.277879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:15.284619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:15.285095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:15.285859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:15.286296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:15.347111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:15.354606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96c9f09c-365c-4c84-a877-835c21e372ef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081264 Aug 03 09:49:15.355174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 827/1529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:15.592539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:15.594771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:15.601222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:15.601662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:15.602406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:15.602832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:15.633915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00f3122a-c616-4f79-9e03-aef6b690db31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 03 09:49:15.634482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 703/1530] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:16.376342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:16.377579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:16.384189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:16.384639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:16.385429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:16.385863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:16.446811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:16.454123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30e3af2d-cbc4-4468-a076-4c29ed66b944 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081730 Aug 03 09:49:16.454688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 828/1531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:16.646325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:16.648458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:16.654885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:16.655325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:16.656076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:16.656511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:16.685078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-43bed222-aa9b-4e19-b2ac-c935db46c140 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Aug 03 09:49:16.685619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 704/1532] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:17.475050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:17.475656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:17.482078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:17.482521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:17.483266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:17.483690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:17.544338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:17.551682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7011fc0-d5aa-4c3b-89cb-da8793798583 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081078 Aug 03 09:49:17.552235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 829/1533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:17.698121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:17.700246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:17.707263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:17.707701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:17.708447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:17.708906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:17.737319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db50a296-19b2-48f8-bd7b-d55397daf992 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042964 Aug 03 09:49:17.737800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 705/1534] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:18.572716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:18.573265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:18.579711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:18.580731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:18.581509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:18.581934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:18.645805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:18.653210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c6fb8f86-e6b6-4593-a95c-e1927be60cf9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084421 Aug 03 09:49:18.653764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 830/1535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:18.749226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:18.751398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:18.758576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:18.759022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:18.759778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:18.760209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:18.777446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:18.793200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9359374d-408b-4217-a6cd-5cd6e049ad0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047926 Aug 03 09:49:18.793759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 706/1536] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:19.675156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:19.675865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:19.682528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:19.682970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:19.683715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:19.684143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:19.746070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:19.754179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e6064f2a-b810-4011-b8f5-2ae01a6930e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083489 Aug 03 09:49:19.754846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 831/1537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:19.805358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:19.807545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:19.814049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:19.815073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:19.815882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:19.816317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:19.845292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e29d2498-23f1-4d3c-aeee-53732429beb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Aug 03 09:49:19.845850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 707/1538] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:20.774994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:20.775601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:20.782004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:20.782445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:20.783927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:20.784530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:20.847691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:20.855112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d9b7686a-47b9-42bf-9f97-7d9148f9627e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084096 Aug 03 09:49:20.855668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 832/1539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:20.857798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:20.859950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:20.866465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:20.866915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:20.867681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:20.868114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:20.897165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4129779f-0281-44a5-b0b9-25e881efe7b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Aug 03 09:49:20.897716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 708/1540] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:21.875802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:21.876407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:21.883801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:21.884249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:21.885032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:21.885460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:21.909102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:21.911241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:21.917850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:21.918297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:21.919059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:21.919488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:21.947329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:21.950159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4db251a3-562e-457b-9146-702a78a2fbf6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 03 09:49:21.950728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 709/1541] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:21.956018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e020e8e8-f709-4a74-992f-550a06f94059 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084024 Aug 03 09:49:21.956585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 833/1542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:22.725317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:49:22.725581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:49:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:49:22.962231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:22.964392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:22.971529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:22.971969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:22.972723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:22.973176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:22.978413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:22.979059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:22.985617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:22.986742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:22.987555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:22.987998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:23.003215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fefd98b8-ce95-4055-a88b-f2d1ba0d2357 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Aug 03 09:49:23.003774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 710/1543] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:23.005903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:23.053810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:23.061422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f5071bd-1c72-43c5-8291-68e4aebc7180 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086869 Aug 03 09:49:23.061983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 834/1544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:24.015459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:24.018250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:24.020254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=58 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:24.025546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:24.026038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:24.026793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:24.027223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:24.056926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-917834e8-2c2c-403b-819c-12325492aac6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Aug 03 09:49:24.057487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 711/1545] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:24.083430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:24.084075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:24.090640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:24.091110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:24.091858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:24.092297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:24.153187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:24.160834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e9c090e7-a91e-4465-a69f-32ca8c9b42a0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081278 Aug 03 09:49:24.161399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 835/1546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:25.069505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:25.071641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:25.078196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:25.078637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:25.079390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:25.079841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:25.108352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-607ffc8e-8f45-418c-8a47-2d51711d64b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Aug 03 09:49:25.108907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 712/1547] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:25.181278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:25.181889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:25.184154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=56 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:25.189817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:25.190259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:25.191011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:25.191437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:25.253131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:25.260593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ba209e4f-3fd3-46e2-aea2-f222b1ebaf02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083137 Aug 03 09:49:25.261189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 836/1548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:26.120195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:26.122442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:26.129889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:26.130336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:26.131084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:26.131512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:26.161268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9752221f-28bc-4d59-8685-82e2782e6a22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044970 Aug 03 09:49:26.161820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 713/1549] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:26.282025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:26.282665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:26.289219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:26.289661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:26.290410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:26.290839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:26.352489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:26.360020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f59d959f-a63f-49f3-bd57-0d1a62aad51f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081801 Aug 03 09:49:26.360583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 837/1550] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:27.176049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:27.179971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:27.187467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:27.187918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:27.188691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:27.189991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:27.223558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50cca803-c519-4f34-a11b-d5f0b0ed6c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053740 Aug 03 09:49:27.224131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 714/1551] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:27.381800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:27.382412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:27.388853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:27.389297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:27.390050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:27.390477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:27.456172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:27.463615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-30cf7422-639d-4f55-806d-aa15cc9b8a7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085664 Aug 03 09:49:27.464172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 838/1552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:28.237406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:28.239573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:28.246342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:28.246784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:28.247541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:28.247969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:28.276382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3dd7bf2d-e58f-4ed3-ab40-bb8c9bc25c08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Aug 03 09:49:28.276959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 715/1553] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:28.484983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:28.486018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:28.492997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:28.493653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:28.494538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:28.494973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:28.555557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:28.563313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-25dcb2b7-de3c-409d-a6e6-10b56b43a56f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082369 Aug 03 09:49:28.563881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 839/1554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:29.289442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:29.291583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:29.298047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:29.299387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:29.300143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:29.300568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:29.329971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6674b32c-331e-4c52-835b-53aa0c75d064 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 03 09:49:29.330526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 716/1555] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:29.585206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:29.585755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:29.592229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:29.592672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:29.593457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:29.593891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:29.657107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:29.664673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-35efed1f-c07a-4bab-b441-b1edadea5704 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083481 Aug 03 09:49:29.665276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 840/1556] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:30.341661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:30.343805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:30.350302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.350751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:30.351517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.351951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:30.381129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3bc0722f-4738-4d54-a237-3043b59d8eb8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 03 09:49:30.381681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 717/1557] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:30.686217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:30.686836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:30.699372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.699372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:30.699372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.699372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:30.759773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:30.767359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9805e196-2cbe-49a3-981c-468d49ae18e8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085011 Aug 03 09:49:30.767926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 841/1558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:30.986332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:30.986835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:30.992839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.993303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:30.994047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:30.994478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.018839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:49:31.096198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-470ef19e-bc75-403a-a9d0-286a48dda641 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 204 len: 0 microversion: 2.20 time: 0.114000 Aug 03 09:49:31.096897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 718/1559] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 3 09:49:30 2022] DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 09:49:31.105417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:31.106049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:31.113395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.113843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.114606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.115040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.248842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:31.257684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:31.259202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:31.260366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b5a15d8c-1baf-4394-9bc0-7494a5917417 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159203 Aug 03 09:49:31.260939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 842/1560] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:31.393533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:31.395736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:31.402299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.402741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.403489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.403915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.432490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a85c2107-bce6-4a6a-8ec3-e98d48e08922 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Aug 03 09:49:31.433070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 719/1561] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:31.788003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:31.788609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:31.795078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.795520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.796280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:31.796688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:31.858730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:31.866198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3575a3e3-8a2f-471d-9057-b727ebe98b96 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082056 Aug 03 09:49:31.866752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 843/1562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:32.284030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:32.284626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:32.290745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.291198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.291951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.293074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.427235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:32.435645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:32.437163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:32.438344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9df11f6-10bf-4ea1-9860-cdd8cd09ec89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158206 Aug 03 09:49:32.439560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 720/1563] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:32.445483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:32.447797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:32.453855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.454340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.455094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.455528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.484161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54d74d7b-bd10-4b0f-bea3-6ec21f821bd9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042899 Aug 03 09:49:32.484705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 844/1564] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:32.887464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:32.888097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:32.895005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.895451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.896213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:32.896674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:32.915474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:32.963701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:32.971799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d886a6d-5f38-47f3-90c6-19f51cf3d0e6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088233 Aug 03 09:49:32.972364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 721/1565] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:33.462339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:33.462944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:33.469452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:33.470471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:33.471439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:33.471900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:33.497071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:33.499352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:33.506432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:33.506881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:33.507653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:33.508088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:33.538780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e77b49aa-6564-41c0-ba03-a7a9a77febcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Aug 03 09:49:33.539351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 722/1566] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:33.601261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:33.609666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:33.611189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:33.612334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ccb2b6f-e3df-4a25-949f-acbaa974b2b7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153922 Aug 03 09:49:33.612902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 845/1567] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:33.992752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:33.993379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:33.999555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:33.999989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.000736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:34.001777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.061683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:34.070104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-042ab5de-0942-4bdd-a0be-c11dc0e8b13d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081206 Aug 03 09:49:34.070665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 723/1568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:34.551611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:34.553806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:34.560270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:34.560720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.561510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:34.561945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.591275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c596ed40-9d6b-4d7f-b840-a0a110a23a57 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Aug 03 09:49:34.591819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 846/1569] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:34.635435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:34.636044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:34.642757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:34.643205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.643967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:34.644402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:34.776514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:34.785402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:34.786893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:34.788047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f6b2ffc9-96c9-4a6a-85dc-a962ab59cf24 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156504 Aug 03 09:49:34.788603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 724/1570] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:35.091571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:35.092218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:35.098866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.099303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.100082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.100512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.164526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:35.172324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1415718c-e742-4bce-a234-ec8de650695a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084561 Aug 03 09:49:35.173616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 847/1571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:35.604425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:35.606621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:35.613015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.614352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.615447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.616253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.647701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc38ae98-96d6-4e12-bb5a-fb1a269dd6e5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Aug 03 09:49:35.648345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 725/1572] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:35.811787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:35.812438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:35.819767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.820205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.820999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:35.821440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:35.951242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:35.959606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:35.961154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:35.962299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a14857e-ee4f-4d63-b555-3f874da717e0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154483 Aug 03 09:49:35.962851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 848/1573] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:36.193386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:36.194000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:36.200128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.200573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:36.201356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.201795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:36.262666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:36.270386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f678587-d6a0-4fa1-a475-67e10c886001 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081854 Aug 03 09:49:36.270962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 726/1574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:36.660520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:36.662721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:36.668757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.669264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:36.670025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.670459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:36.701168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6fd3b0d3-e53c-4cb8-b1cf-843e3c784c18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Aug 03 09:49:36.701710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 849/1575] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:36.986119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:36.986854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:36.993680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.994130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:36.994902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:36.995341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:37.146263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:37.157971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:37.159760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:37.161522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8986125-ead1-4eed-8bdd-73fb8ae966a7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.179990 Aug 03 09:49:37.162264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 727/1576] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:37.291661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:37.292227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:37.299120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:37.299565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:37.300336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:37.300772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:37.372254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:37.380721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a8f1b43-e268-4f2a-83a3-b8e573326f35 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.092969 Aug 03 09:49:37.381404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 850/1577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:37.713815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:37.715993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:37.722577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:37.723027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:37.723788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:37.724225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:37.753330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9c8535d-8b4d-4c85-ac09-6121fa21a220 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043407 Aug 03 09:49:37.753912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 728/1578] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:38.184965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:38.185571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:38.192631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.192984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.193748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.194174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.198220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:38.330229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:38.338655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:38.340200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:38.341385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-afec92bc-f78f-442e-8169-9520ee859d1e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160343 Aug 03 09:49:38.341946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 851/1579] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:38.403191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:38.403804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:38.411124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.411573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.412331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.412764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.476591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:38.484118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-975c8995-22aa-4f27-b1e7-d5e103f78ac7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084738 Aug 03 09:49:38.484679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 729/1580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:38.765687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:38.767912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:38.773872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.774343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.775092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:38.775519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:38.806120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-863a57de-508b-43d8-bfc2-9cbadcfe4328 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Aug 03 09:49:38.806658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 852/1581] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:39.365342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:39.365941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:39.372136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.372582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.373399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.373830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.503021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:39.506012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:39.506630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:39.511545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:39.512985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.513107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:39.513434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.514188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.514288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c55c47d-d0b3-4999-836c-b8477f96724d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152922 Aug 03 09:49:39.514619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.515058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 730/1582] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:39.581263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:39.588750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-80dc89b4-9e43-419c-9402-153efacd5158 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087661 Aug 03 09:49:39.589352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 853/1583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:39.819294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:39.821405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:39.827379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.827821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.828569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:39.829031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:39.856662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9df9a4a-3191-4fbb-9e84-9fad9559224b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041790 Aug 03 09:49:39.857233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 731/1584] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:40.537826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:40.538514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:40.545343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.545789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.546542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.546970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.609094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:40.609703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:40.616639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.617114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.617878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.618311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.676804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:40.683824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:40.685321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:40.686823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:40.688004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4161aa26-2e4c-4fdb-bd5b-6b5c38fad262 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154901 Aug 03 09:49:40.688555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 854/1585] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:40.691847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bc77aac7-6f54-4fef-8d83-850f10ec6802 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086715 Aug 03 09:49:40.692882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 732/1586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:40.869000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:40.871129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:40.877355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.877948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.878803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:40.879244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:40.907094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0f1ac025-39ac-4adc-bd60-069caf16794f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042115 Aug 03 09:49:40.907628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 855/1587] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:41.712243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:41.712943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:41.712943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:41.713404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:41.719323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.719625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.719752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.720066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.720507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.720830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.721459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.721840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.788388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:41.795859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-819feba2-4177-41ff-892a-a4bf206ad3f8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087366 Aug 03 09:49:41.796421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 856/1588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:41.853054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:41.861252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:41.862927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:41.864100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-672cbd96-a887-4b53-98af-6d3bdec67beb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155778 Aug 03 09:49:41.864650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 733/1589] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:49:41.919496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:41.921683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:41.927679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.928118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.928888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:41.929319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:41.957851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9b6043a6-3d04-4ff4-b28a-49d52b3e0b28 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042269 Aug 03 09:49:41.958391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 857/1590] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:42.818297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:42.818898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:42.825423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.825860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:42.826603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.827028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:42.886466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:42.887106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:42.887904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:42.894160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.894602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:42.895361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.895791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:42.896115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe92d42e-fae2-494d-8068-98bef3a91a69 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081991 Aug 03 09:49:42.896678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 734/1591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:42.969443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:42.972229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:42.978354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.978803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:42.979569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:42.980003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:43.009716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d883a98-0f27-4955-9b55-0e8f19b7e2b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 03 09:49:43.010283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 735/1592] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:43.026238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:43.035239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:43.036735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:43.037924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a7757a74-17a3-42d6-b380-876aad2be0e1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155485 Aug 03 09:49:43.038465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 858/1593] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:49:43.917593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:43.918200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:43.925512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:43.925952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:43.926708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:43.927140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:43.987666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:43.995065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8727c168-d0d2-4ba6-a7bb-aa83fb295c02 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081332 Aug 03 09:49:43.995619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 736/1594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:44.021745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:44.023923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:44.030420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:44.030868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:44.031625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:44.032061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:44.061413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:44.062020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:44.062725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-70d447b8-0478-43bb-9de4-0e08dfdb7da2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Aug 03 09:49:44.063294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 859/1595] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:44.068513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:44.068986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:44.069746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:44.070176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:44.200529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:44.210291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:44.212088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:44.213266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d256b1cf-800e-4364-a66f-acc6bd5cc779 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155780 Aug 03 09:49:44.213832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 737/1596] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:49:45.015965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:45.016572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:45.023269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.023895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.024450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.024912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.075255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:45.077428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:45.084741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.085240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.086022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.086304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:45.086462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.090300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:45.095136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f1c40bf-c231-49fe-a2ff-d57b93b00a90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081840 Aug 03 09:49:45.095715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 860/1597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:45.117877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-72d1f206-3822-4c47-a7fd-416bef91513c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046560 Aug 03 09:49:45.118430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 738/1598] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:45.237069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:45.237682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:45.243663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.244110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.244953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:45.245388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:45.375493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:45.384566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:45.386111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:45.387263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2ac4128-20ca-47e9-960a-66878b641397 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154195 Aug 03 09:49:45.387818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 861/1599] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:46.116589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:46.117297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:46.123881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.124327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.125122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.125558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.131252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:46.133469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:46.140046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.140497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.141298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.145379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.176928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e8f86646-d2a4-4eb2-9c4a-58ba6e638b24 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050666 Aug 03 09:49:46.177502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 862/1600] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:46.192738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:46.200409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e8cfa17-46be-4245-ae3e-8be8e02a465f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087779 Aug 03 09:49:46.201000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 739/1601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:46.411213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:46.411828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:46.417851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.418297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.419052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:46.419484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:46.546218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:46.555114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:46.556630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:46.557870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e3d403d5-06dd-49a5-9f45-39e7f1b17ae4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151136 Aug 03 09:49:46.558432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 863/1602] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:47.189233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:47.191488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:47.198321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.198766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.199524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.199956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.221948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:47.222640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:47.229142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.229943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.230702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.231134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.231589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b9f370b-57f7-46ea-b079-166b5ce081a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046356 Aug 03 09:49:47.232153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 740/1603] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:47.296562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:47.304190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-59dd5093-ea28-410f-9de3-a3636320dda6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086806 Aug 03 09:49:47.304747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 864/1604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:47.582980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:47.583584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:47.591191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.592007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.593412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:47.594213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:47.722116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:47.730440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:47.731933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:47.733112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3954c0c8-dd6e-40bf-b9f2-7040415e4c40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154779 Aug 03 09:49:47.733670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 741/1605] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:48.243471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:48.245683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:48.252616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.253089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.253841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.254268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.282942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-94f72ff0-dfd0-4a93-b682-9de0cf7f988e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 03 09:49:48.283978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 865/1606] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:48.325030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:48.325635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:48.332712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.333176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.333923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.334354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.395022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:48.402381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-da675985-f0ed-4b73-b908-9894dd0989e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081195 Aug 03 09:49:48.402934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 742/1607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:48.756275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:48.756909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:48.762910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.763357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.764139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:48.764572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:48.892684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:48.901063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:48.902569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:48.903717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-66a40dfd-e2ae-49c3-a6a3-1fbe4d2ace9a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151978 Aug 03 09:49:48.904267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 866/1608] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:49.295677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:49.297869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:49.304463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.304939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:49.305742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.306122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:49.335160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8aeaffc8-25d9-484e-b3b0-6dd009951515 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Aug 03 09:49:49.335773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 743/1609] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:49.424010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:49.425061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:49.431136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.431583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:49.432369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.432823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:49.498285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:49.501715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:49.506670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-52eb5bf2-9860-49ba-8554-04fd949c533a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086782 Aug 03 09:49:49.507232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 867/1610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:49.927915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:49.928519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:49.934550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.934997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:49.935780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:49.936210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:50.067548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:50.075747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:50.077264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:50.078440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-97a88797-8979-403c-b570-511ef3bdda1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155773 Aug 03 09:49:50.079023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 744/1611] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:50.348180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:50.350430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:50.356646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:50.357111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:50.357872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:50.358308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:50.386560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e53669aa-34e0-476a-ac96-2d31d0ccee5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043138 Aug 03 09:49:50.387113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 868/1612] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:50.527676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:50.528284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:50.535185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:50.535652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:50.536412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:50.536872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:50.598798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:50.606235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-37c5e9f8-42e4-4ca4-bce1-a428e81d5f5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082360 Aug 03 09:49:50.606790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 745/1613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:51.102311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:51.102915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:51.109456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.109900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.110648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.111075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.243862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:51.252162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:51.254355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:51.255508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f48bf81-3116-49cd-a319-d693f307738e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157126 Aug 03 09:49:51.256065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 869/1614] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:51.399047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:51.401466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:51.407412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.407852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.408598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.409050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.437993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c1b5e5ed-26ce-41ff-b351-b0f51418e561 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042939 Aug 03 09:49:51.438533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 746/1615] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:51.627044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:51.627673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:51.634653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.635090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.635841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:51.636270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:51.696443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:51.703782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-28bc099e-6c31-49d8-b5ec-59343e6995df tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080651 Aug 03 09:49:51.704337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 870/1616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:52.278231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:52.278824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:52.285306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.285741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.286480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.286907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.415311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:52.423580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:52.425107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:52.426851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-efd885d1-71b9-4b49-ab5a-0eb370658d5b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152612 Aug 03 09:49:52.427400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 747/1617] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:52.450739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:52.452976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:52.459949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.460395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.461201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.461638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.490446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bccf1a5-f772-4340-a9be-ae6a54b42ec9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Aug 03 09:49:52.490987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 871/1618] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:52.725455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:52.725990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:52.732087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.732530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.733335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:52.733753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:52.796625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:52.805225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66847ce6-0646-42ce-94f5-843c5729592a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084237 Aug 03 09:49:52.805790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 748/1619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:53.450619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:53.451223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:53.458258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.458696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.459437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.459862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.502873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:53.505944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:53.511939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.512377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.513158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.513582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.543448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b407ca8-d1ff-4991-a538-d07aa609c6f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Aug 03 09:49:53.544201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 749/1620] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:49:53.588935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:53.597327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:53.599512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:53.600670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bf217fcb-b4c1-45e8-a61b-ec605ab7bf95 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153986 Aug 03 09:49:53.601281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 872/1621] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:53.826399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:53.826933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:53.833597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.834031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.834772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:53.835196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:53.894938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:53.902268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35abf0c1-e4ba-40be-b237-ce2b7ef20932 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079938 Aug 03 09:49:53.902820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 750/1622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:54.556073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:54.558273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:54.564878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.565334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.566102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.567393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.595458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a72196f3-a212-4247-ad3c-18c2a0c549ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043362 Aug 03 09:49:54.596001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 873/1623] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:54.624450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:54.625073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:54.627367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:54.633366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.633806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.634556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.634980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.767368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:54.775785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:54.777312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:54.778469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-967307cf-32ba-4b92-ac2f-d669e3d2c66a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157870 Aug 03 09:49:54.779021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 751/1624] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:54.923368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:54.923994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:54.930615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.931066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.931828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:54.932266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:54.995733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:55.003352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-52068bde-1e71-4169-8e68-6fa8b8196eb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083793 Aug 03 09:49:55.004020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 874/1625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:55.607549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:55.610134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:55.616284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:55.616723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:55.617683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:55.617935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:55.651538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4498b884-157b-44ca-a269-e9203680bcc8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047868 Aug 03 09:49:55.652243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 752/1626] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:55.803680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:55.804232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:55.806539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:55.812237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:55.812679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:55.813451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:55.813881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:55.943326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:55.951567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:55.953114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:55.954263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-637c6417-4c43-47d4-aaa1-d7362e349601 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155262 Aug 03 09:49:55.954813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 875/1627] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:56.024350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:56.024984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:56.030881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.031324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:56.032079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.032504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:56.096004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:56.104051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92025166-b1c5-4d48-82a4-404804eae085 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083566 Aug 03 09:49:56.104619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 753/1628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:56.663760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:56.665972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:56.671961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.672403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:56.673189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.673617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:56.703063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa731ef4-8f4b-40bd-92e0-cacd88985324 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Aug 03 09:49:56.703600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 876/1629] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:56.977511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:56.978028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:56.984523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.985012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:56.985758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:56.986182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:57.114497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:57.117923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:49:57.123728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:57.124598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:57.125239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:57.125372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:57.126444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51591add-9bd7-43de-ab66-3cd8daa77742 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152888 Aug 03 09:49:57.126997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 754/1630] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:57.132341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:57.132790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:57.133581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:57.134014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:57.195595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:57.203215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1dd139e7-3542-453e-bebf-f6fa9e555104 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082367 Aug 03 09:49:57.203787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 877/1631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:57.715831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:57.718000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:57.724316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:57.724757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:57.725529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:57.725959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:57.755379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-20d83349-d55d-42de-8438-787c6217eb1c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043473 Aug 03 09:49:57.755921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 755/1632] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:58.150668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:58.151276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:58.157732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.158178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.158924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.159352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.226124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:58.226739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:58.233116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.233557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.234321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.234748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.293112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:58.297633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:58.301927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:58.303443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:58.304620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-61751be0-111a-4431-9d72-e15f4310b672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157944 Aug 03 09:49:58.305183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9a6d33f-1b9b-4554-8bf1-ed30296df075 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083791 Aug 03 09:49:58.305364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 878/1633] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:49:58.305738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 756/1634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:49:58.767411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:58.770382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:58.776442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.776925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.777688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:58.778121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:58.807821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-53d910d5-a122-47c7-af6a-db4a1b25d974 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Aug 03 09:49:58.808375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 879/1635] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:49:59.326083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:59.326604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:59.327282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:59.327886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:59.333792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.334236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.334993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.335212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.335415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.335669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.336429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.336887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.402721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:59.410248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-94c09fdd-3a38-4222-a703-5aa10a342c47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088034 Aug 03 09:49:59.410960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 757/1636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:49:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:49:59.466285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:59.474637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:59.476115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:49:59.477280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-79044ede-4470-4f93-a91d-68cdb54220e6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153857 Aug 03 09:49:59.477830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 880/1637] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:49:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:49:59.821142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:49:59.823290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:49:59.829282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.829727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.830480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:49:59.830912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:49:59.860510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f42b6238-4d49-44ef-9840-9e4d2a469a1f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044632 Aug 03 09:49:59.861010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 758/1638] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:49:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:00.430848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:00.431460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:00.438070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.438512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.439264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.439688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.500049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:00.500451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:00.500641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:00.507075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.507513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.508141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4026ef7e-7d62-41fd-8d7d-8517d7dbcfb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081145 Aug 03 09:50:00.508276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.508675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.508849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 881/1639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:00.636656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:00.645531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:00.647014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:00.648160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-880e515f-6090-4ac0-a27c-f4466ec5f1c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151998 Aug 03 09:50:00.648720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 759/1640] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:00.872890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:00.875062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:00.881750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.882195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.882950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:00.883381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:00.912283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3db28f3-ea46-4242-b7a3-a35ecaf1e896 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 Aug 03 09:50:00.912841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 882/1641] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:01.529801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:01.530324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:01.537295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.537736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.538502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.538929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.600623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:01.608473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a66e65ea-db1c-4f9d-a9bf-b97ced2a50d3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082573 Aug 03 09:50:01.609069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 760/1642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:01 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:01.670658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:01.671267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:01.678543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.678992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.679749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.680182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.813201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:01.822036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:01.823579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:01.824734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a56134be-2e7a-455e-bcab-5ca52886fd10 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158060 Aug 03 09:50:01.825321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 883/1643] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:01.923863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:01.926044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:01.931942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.932378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.933150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:01.933577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:01.962130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c75bd82-3a12-4941-b28e-3719ca9c9585 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Aug 03 09:50:01.962672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 761/1644] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:02.629857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:02.630459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:02.636643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.637115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.637865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.638294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.657866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:02.703933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:02.711947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-61c68787-ddaf-4a40-a71f-f6811ac1ebb9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086079 Aug 03 09:50:02.712501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 884/1645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:02.848157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:02.848771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:02.855435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.855900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.856672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.857135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.974667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:02.976857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:02.982782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.983226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.983981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:02.984406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:02.990991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:03.000053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:03.001610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:03.002771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04721a01-fc7d-40ad-84c4-6d63d91fbac3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158755 Aug 03 09:50:03.003858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 762/1646] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:03.013946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10afa28b-f4d1-4b0e-b76a-878a9b1a8c86 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Aug 03 09:50:03.014491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 885/1647] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:03.733049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:03.733658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:03.740389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:03.740847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:03.741607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:03.742036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:03.802558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:03.809993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc02a91f-e72c-4fa8-9d3c-6b2fbc926f52 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080816 Aug 03 09:50:03.810558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 763/1648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:04.026519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:04.027076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:04.027467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:04.028651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:04.033576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.034015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.035575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.035725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.035975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.036159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.037016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.037452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.068745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ef6a6ef-7fbd-4a21-83b9-8bca4695ace5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046202 Aug 03 09:50:04.069344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 886/1649] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:04.166180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:04.174632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:04.176654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:04.177831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dab5b3cb-4daa-4f2c-ba02-72397d4ed6b4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154981 Aug 03 09:50:04.178382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 764/1650] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:04.830592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:04.831130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:04.837617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.838064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.838824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:04.839257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:04.899720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:04.907148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7742610b-718f-41e0-ada4-4c8c4ad04571 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080510 Aug 03 09:50:04.907733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 887/1651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:05.081484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:05.083559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:05.089961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.090405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:05.091155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.091590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:05.120580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f6ce8b80-2942-4ed9-9445-cf261e2b6524 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Aug 03 09:50:05.121144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 765/1652] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:05.201898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:05.202534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:05.209763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.210214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:05.210995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.211421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:05.343251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:05.351925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:05.353491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:05.354650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-006d4062-5e34-434c-8acd-08cecf754159 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156676 Aug 03 09:50:05.355215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 888/1653] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:05.928898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:05.929440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:05.935450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.935899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:05.936661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:05.937129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:06.000892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:06.008407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07ee1f4b-e9f4-4e39-b2a2-295262e22d8c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084146 Aug 03 09:50:06.009016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 766/1654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:06.133111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:06.135335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:06.141787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:06.142294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:06.143118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:06.143573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:06.174189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e4c356c-33fa-41df-b0d3-2330e863c8e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Aug 03 09:50:06.174723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 889/1655] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:06.377903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:06.379108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:06.385625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:06.386064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:06.386822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:06.387251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:06.512542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:06.521155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:06.522659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:06.523818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-98ba8df2-ce3f-4242-be88-d5eeb51a6f1d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149901 Aug 03 09:50:06.524375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 767/1656] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:07.029707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:07.030335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:07.037448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.037894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.038650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.039084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.101174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:07.108642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c04f6aad-771a-410a-b315-7ec980b4daff tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082842 Aug 03 09:50:07.109235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 890/1657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:07.186391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:07.188491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:07.194872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.195310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.196063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.196483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.226125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38f6a624-27d4-4755-8b71-dc051920e8d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043676 Aug 03 09:50:07.226669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 768/1658] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:07.548283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:07.548913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:07.555376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.555848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.556598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:07.557064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:07.686321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:07.696038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:07.697572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:07.698732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd078ee5-fc0b-40af-b820-94a92063e903 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154384 Aug 03 09:50:07.699293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 891/1659] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:08.131163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:08.131777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:08.138340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.138789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.139551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.139985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.202761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:08.210800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12284825-c815-467f-875d-b17f6aba1300 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084100 Aug 03 09:50:08.211366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 769/1660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:08.238232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:08.240354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:08.246820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.247295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.248051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.248480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.278135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-46b2d69d-41cd-4f41-ac8e-5638406161b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 03 09:50:08.278680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 892/1661] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:08.722557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:08.723161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:08.729193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.729641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.730407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:08.730846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:08.863092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:08.871398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:08.872937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:08.874091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d04516d-1cd7-4740-9c6c-8b6b0297d42b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155474 Aug 03 09:50:08.874651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 770/1662] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:09.231909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:09.232526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:09.238721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.239309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:09.240851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.241286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:09.292195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:09.294363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:09.301594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.302056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:09.302820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.303272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:09.306998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:09.314585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fee46be4-5448-4512-af3e-8f81eeee9281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086577 Aug 03 09:50:09.315158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 893/1663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:09.321828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:09.335780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50a10a7e-18a2-4d60-a456-5748fbdc04dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 Aug 03 09:50:09.336343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 771/1664] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:09.898108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:09.898747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:09.904788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.905259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:09.906011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:09.906443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:10.034014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:10.043127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:10.044631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:10.045815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7b18615-1452-4b8a-b5eb-18871e095001 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152244 Aug 03 09:50:10.046380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 894/1665] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:10.335629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:10.336183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:10.342672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:10.343261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:10.344014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:10.344439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:10.348307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:10.350514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:10.356906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:10.357357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:10.358118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:10.358548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:10.388073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41bb4600-856c-42eb-941d-4972c4fa007d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044405 Aug 03 09:50:10.388641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 895/1666] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:10.414101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:10.421604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a369fc1-3a25-490a-8247-99383424564b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.089983 Aug 03 09:50:10.422160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 772/1667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:11.069672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:11.070277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:11.076317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.076763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.077656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.078091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.207054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:11.215713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:11.217246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:11.218408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-458c206b-b961-4710-9aef-b86af62fb94a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153021 Aug 03 09:50:11.218954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 896/1668] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:11.400390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:11.403048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:11.410597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.411050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.411828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.412286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.443289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3afdee6c-0306-4a44-bfd0-e439520aa2c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Aug 03 09:50:11.444028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 773/1669] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:11.444409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:11.445055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:11.451789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.452337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.453174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:11.453610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:11.520907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:11.528444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-41b0351e-10ea-4b17-b053-0b9ac93590f2 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088896 Aug 03 09:50:11.529049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 897/1670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:12.241795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:12.242401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:12.248345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.248790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.249579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.250014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.377174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:12.386323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:12.387824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:12.389078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c3d75885-db68-48a7-afdf-625a03fc065f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151983 Aug 03 09:50:12.389645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 774/1671] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:12.455402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:12.457988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:12.464517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.465009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.465766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.466201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.495817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2de4e341-eb0b-45d9-b47f-0316377d24ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044353 Aug 03 09:50:12.496361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 898/1672] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:12.550660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:12.551271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:12.557623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.558065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.558822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:12.559252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:12.623284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:12.630710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1a99ab21-270d-46b8-8303-06f14adb3bef tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084460 Aug 03 09:50:12.631268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 775/1673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:12 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:13.412442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:13.413132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:13.419163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.419612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.420355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.420782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.508003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:13.510199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:13.516203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.516648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.517465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.517908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.547569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8f33333-ac2b-4a2c-97ec-ab4ca6918aa8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 03 09:50:13.548144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 776/1674] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:13.549448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:13.558599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:13.560091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:13.561278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1431203-7d88-4028-a581-5f140c701d2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152907 Aug 03 09:50:13.561823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 899/1675] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:13.651175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:13.651783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:13.658129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.658566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.659352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:13.659794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:13.722634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:13.730033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0d4aca6d-0118-4aaa-b6bb-e55f596c7fb1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082672 Aug 03 09:50:13.730593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 777/1676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:14.559929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:14.562119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:14.568550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.569022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.569773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.570202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.585895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:14.586496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:14.592473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.592942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.593692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.594121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.600118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-231a61f5-0fb0-469c-a529-3bd13f5472a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 03 09:50:14.600683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 900/1677] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:14.720885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:14.730017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:14.731517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:14.732703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63792af5-10af-43aa-bf24-9a14e99d6312 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151222 Aug 03 09:50:14.733294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 778/1678] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:14.751076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:14.751699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:14.758400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.758839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.759582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:14.760007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:14.763868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:14.821106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:14.828499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fc74ab63-8516-4df6-b11a-b13f12589c90 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081260 Aug 03 09:50:14.829113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 901/1679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:15.611679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:15.613842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:15.619829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.620469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.621129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.621655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.652383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b9347c94-b992-4367-a1e9-29d657a893a9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 03 09:50:15.652961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 779/1680] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:15.755557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:15.756224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:15.762715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.763158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.763905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.764330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.850464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:15.851074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:15.857508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.857955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.858718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:15.859150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:15.896377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:15.904917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:15.906464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:15.907624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81255602-9839-4a5e-a06b-e272f3e6d56a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156012 Aug 03 09:50:15.908192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 902/1681] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:15.921520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:15.929150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3f75189b-8849-449d-b5b9-8a3af87d62c8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083522 Aug 03 09:50:15.929840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 780/1682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:16.665311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:16.667470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:16.673477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.673926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:16.674678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.675110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:16.704633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87ec69c9-7a30-4e33-919a-01a3833b415d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 Aug 03 09:50:16.705205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 903/1683] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:16.931655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:16.932184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:16.938762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.939208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:16.940061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.940498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:16.950284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:16.950897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:16.958240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.958684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:16.959449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:16.959883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:17.023580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:17.031231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15ad21ab-2c03-49e1-8f6a-1ee688b95892 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084741 Aug 03 09:50:17.031804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 904/1684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:17.074287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:17.083382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:17.084915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:17.086081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c1b080e9-3049-4f7a-a160-fb259823129f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158450 Aug 03 09:50:17.086637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 781/1685] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:17.720862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:17.724310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:17.730388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:17.730838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:17.731594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:17.732027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:17.762113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a87478b2-cb39-4859-956c-569ef6198a2c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048658 Aug 03 09:50:17.762665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 905/1686] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:18.052136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:18.052665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:18.059515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.059968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.060740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.061201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.108837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:18.109440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:18.116238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.116688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.117481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.117913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.123526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:18.131792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8eff8308-2c71-431a-a259-00c452fce206 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083689 Aug 03 09:50:18.132580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 782/1687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:18.247264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:18.255841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:18.257400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:18.258554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d90e7c1f-036d-4325-b925-ae1745964c7b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153607 Aug 03 09:50:18.259105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 906/1688] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:18.774478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:18.776583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:18.782630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.783063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.783805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:18.784759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:18.813012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5c33fbcb-3da4-4a13-bd68-f1e4c0d2785b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042553 Aug 03 09:50:18.813548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 783/1689] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:19.153277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:19.153885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:19.160911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.161355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.162100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.162529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.226328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:19.233814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4d9bb051-e514-43fd-b36c-525e346ed94b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084422 Aug 03 09:50:19.234367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 907/1690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:19.282417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:19.283014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:19.289613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.290049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.290792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.291217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.421547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:19.430410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:19.431970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:19.433189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-67d727e3-c9fa-4a8d-acdf-fe7eb5e33b16 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154586 Aug 03 09:50:19.433950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 784/1691] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:19.827580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:19.829669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:19.836279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.836727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.837513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:19.837954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:19.867192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b44660d5-6f4e-4555-ae1c-0a97b09e2b7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 Aug 03 09:50:19.867737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 908/1692] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:20.255057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:20.255665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:20.261722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.262166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.262922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.263350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.324738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:20.332350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d2c576b-1f14-48cb-9deb-ad0554304136 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081456 Aug 03 09:50:20.332936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 785/1693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:20.458026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:20.458682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:20.465191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.465637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.466390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.466825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.593462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:20.602519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:20.604023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:20.605282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8952abad-ba09-49c7-9f08-ef640c04201b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152374 Aug 03 09:50:20.605839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 909/1694] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:20.878653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:20.881457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:20.887448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.887892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.888644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:20.889098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:20.918566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b2eb9b7-1af1-40f7-b5e2-d36a0ad817e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Aug 03 09:50:20.919125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 786/1695] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:21.353855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:21.354505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:21.360484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.360973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.361740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.362177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.424720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:21.432425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4dd11c5e-ffb6-414e-86e5-7737173f087a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082511 Aug 03 09:50:21.433006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 910/1696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:21.628740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:21.630304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:21.636728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.637200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.637972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.638384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.772213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:21.780551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:21.782092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:21.783251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-39704ae1-307a-4807-96b8-deb7e39e2d25 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158448 Aug 03 09:50:21.783809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 787/1697] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:21.930780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:21.932939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:21.939605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.940046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.940802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:21.941256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:21.971946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02312b3f-0539-4838-88a4-1c8999d371d0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Aug 03 09:50:21.972411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 911/1698] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:22.454654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:22.455243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:22.461977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.462416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:22.463166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.463598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:22.467508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:22.523775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:22.531243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-20fa6f6f-0c20-4eec-a894-1885ab45e2ec tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080432 Aug 03 09:50:22.531795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 788/1699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:22.807398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:22.807923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:22.814060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.814503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:22.815288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.815715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:22.958165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:22.966493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:22.967995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:22.969394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5563f75c-4776-43b1-9510-d48a08886331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.165726 Aug 03 09:50:22.975870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 912/1700] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:22.984767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:22.986970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:22.994103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.994547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:22.995301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:22.995735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:23.026222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f20b9e3d-5b4d-42e7-9dc6-0baf243c0138 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 03 09:50:23.026772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 789/1701] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:23.551879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:23.552408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:23.558502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:23.558950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:23.559701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:23.560136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:23.620199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:23.627533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-13e05451-9ad6-4589-85f8-d35f4ab04100 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079808 Aug 03 09:50:23.628096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 913/1702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:23 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:23.992872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:23.993473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:23.999746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.000182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.000950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.001374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.037923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:24.040107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:24.046574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.047017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.047929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.048366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.080168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f6cc5513-6226-4ef5-9057-e863edd5a30e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Aug 03 09:50:24.080726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 914/1703] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:24.134286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:24.142898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:24.144393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:24.145715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-63435f63-65ee-44e9-9a37-88119fd7e6bd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156728 Aug 03 09:50:24.146268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 790/1704] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:24.648243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:24.648872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:24.655314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.655759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.656514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:24.656992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:24.719505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:24.727892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-85d4af55-b12b-4506-9f08-7db3ce8cf970 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083463 Aug 03 09:50:24.728460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 915/1705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:25.094761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:25.096961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:25.099987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=80 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:25.105298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.105736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.106486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.106910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.135388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61d84c0d-03a5-45a4-8495-f8d2e6045d8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Aug 03 09:50:25.135939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 791/1706] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:25.167495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:25.168107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:25.174623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.175072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.176167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.176272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.307708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:25.316062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:25.317893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:25.319035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fef18b8f-fadc-4a11-9d62-0952936d0257 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155401 Aug 03 09:50:25.319589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 916/1707] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:25.749761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:25.750407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:25.756940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.757382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.758137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:25.758568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:25.820097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:25.827597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9b5bf0ca-08ed-4d07-b307-8be80b11d6ae tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081732 Aug 03 09:50:25.828157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 792/1708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:26.148265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:26.150437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:26.152335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=84 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:26.157849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.158299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.159064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.159501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.185040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:26.190241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b5a2cf21-d756-41ed-aca6-04cd0a2a1d8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 03 09:50:26.190807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 917/1709] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:26.341756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:26.342280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:26.348660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.349128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.349875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.350301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.480429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:26.489757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:26.491246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:26.492386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-54aba45d-2e4b-424c-8917-c345725ed808 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154636 Aug 03 09:50:26.492968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 793/1710] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:26.849773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:26.850388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:26.856542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.857019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.857779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:26.858211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:26.918403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:26.926469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2d104f7-3427-4133-a4b7-d62eaada9702 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080703 Aug 03 09:50:26.927039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 918/1711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:27.203418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:27.205577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:27.212183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.212620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:27.213410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.213837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:27.242508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a2881732-ff8c-4c7d-b9b0-9ab3b8d39da3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043136 Aug 03 09:50:27.243057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 794/1712] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:27.293542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:50:27.293712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:50:27.515750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:27.516294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:27.523629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.524079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:27.524869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.525311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:27.650666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:27.659240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:27.661517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:27.662679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c37b432-87d0-4a32-8efb-ac7e3ae1ef3d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150960 Aug 03 09:50:27.663240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 919/1713] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:27.947460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:27.948071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:27.954436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.954871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:27.955614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:27.956036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:28.017065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:28.025082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4d953b9-86f8-46df-a2d7-bf33295e0a5e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081483 Aug 03 09:50:28.025637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 795/1714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:28.255405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:28.257513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:28.263542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:28.263985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:28.264737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:28.265191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:28.293848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a9b9f25f-ea65-4c79-9664-bbca96320c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Aug 03 09:50:28.294392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 920/1715] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:28.686231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:28.686834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:28.693745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:28.694195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:28.694955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:28.695382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:28.821089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:28.829373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:28.830881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:28.832671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0692f981-5bbf-453a-80cc-28ac790ec943 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149748 Aug 03 09:50:28.836081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 796/1716] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:29.047245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:29.047789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:29.054729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.055381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:29.055928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.056361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:29.118771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:29.126247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04a44b2e-e205-4f6d-9a21-86bb5d7c3d5b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082962 Aug 03 09:50:29.126810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 921/1717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:29.306632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:29.308671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:29.315117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.315558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:29.317186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.317668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:29.346490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d1af7111-b2ff-4a31-9382-bfc2b57471b7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 03 09:50:29.347032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 797/1718] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:29.859426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:29.860059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:29.867091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.867530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:29.868330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:29.868711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:30.142116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:30.148296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:30.148935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:30.151303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:30.152829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:30.153981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-63a7c3f7-fa51-499b-9197-9f20b4afe5e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.298541 Aug 03 09:50:30.154564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 922/1719] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:30.155007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:30.155518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:30.156317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:30.156750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:30.217119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:30.225088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee71cdf3-9434-41ef-b9bd-9b972b9855a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081467 Aug 03 09:50:30.225648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 798/1720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:30.358883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:30.361096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:30.367607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:30.368049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:30.368799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:30.369246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:30.398336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-248951fd-c668-44f6-b937-8dc0bb6c488f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043405 Aug 03 09:50:30.398802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 923/1721] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:31.178330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:31.178709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:31.185141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.185589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.186349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.186782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.247020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:31.247754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:31.254878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.255423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.256253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.256757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.319183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:31.320975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:31.326713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9fe285bb-25ba-498e-ba87-a8aa23ab5cb8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083624 Aug 03 09:50:31.327286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 924/1722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:31.329562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:31.331072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:31.333163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1b63a63b-28d8-4d0a-81cc-63d9cab957a0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158668 Aug 03 09:50:31.333769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 799/1723] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:31.410359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:31.412638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:31.418607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.419049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.419795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:31.420221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:31.449499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8eacb123-35b0-42e9-a92c-a58b24015abe tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 Aug 03 09:50:31.450042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 925/1724] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:32.347990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:32.348675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:32.355179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.355616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.356366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.356790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.357313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:32.357924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:32.365026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.365470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.366230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.366666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.419915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:32.427605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-56c69f20-9643-4780-b4e7-5cdf2647b73e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084049 Aug 03 09:50:32.428168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 800/1725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:32.462359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:32.464556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:32.470477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.470921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.471675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:32.472100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:32.498384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:32.500971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51429453-16d5-49e0-8741-c807d0c67592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042493 Aug 03 09:50:32.501538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 801/1726] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:32.508833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:32.510431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:32.511583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce076fcc-084b-4b9b-b5ae-d38819cb2814 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158321 Aug 03 09:50:32.512125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 926/1727] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:33.449205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:33.449837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:33.456277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.456725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.457582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.458016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.513361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:33.515518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:33.521107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:33.522369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.522822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.523597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.524035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.528784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c4a044b-0341-4e70-b93a-16718b533450 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083521 Aug 03 09:50:33.529571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 802/1728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:33.534748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:33.535942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:33.541927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.542367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.543117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:33.543547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:33.554697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2e6a8ae-6498-47cd-89fc-48a87e4ccb64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Aug 03 09:50:33.555265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 927/1729] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:33.672799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:33.681723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:33.683222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:33.684371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-350072aa-9fb1-4232-a03b-151bd0d62599 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153282 Aug 03 09:50:33.684950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 803/1730] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:34.550286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:34.551447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:34.557920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.558366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.559126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.559559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.567637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:34.569813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:34.576201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.576645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.577446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.577874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.603177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:34.607728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-354a873c-9042-4b04-8779-c3b4516fcdef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Aug 03 09:50:34.608332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 804/1731] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:34.624091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:34.632750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb0463ea-ba6a-47e5-8a70-ff5a9ddba529 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086311 Aug 03 09:50:34.633340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 928/1732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:34 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:34.707774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:34.708372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:34.714540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.714985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.715742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:34.716174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:34.840842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:34.849661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:34.851161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:34.852319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0891ec21-1962-401a-9314-59796521cdd8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148758 Aug 03 09:50:34.852900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 805/1733] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:35.619673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:35.622037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:35.628747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.629222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:35.629994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.630421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:35.653867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:35.654474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:35.659294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4fc57b78-b473-4379-82b6-00ab3ec2f27c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Aug 03 09:50:35.659887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 929/1734] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:35.661635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.662073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:35.662830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.663253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:35.725087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:35.732683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4abb3b09-b29b-4657-a840-082d1b126be4 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082647 Aug 03 09:50:35.733288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 806/1735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:35.875442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:35.876050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:35.882821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.883267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:35.884022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:35.884452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:36.010046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:36.018429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:36.020553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:36.021734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e63511e6-5235-4048-bee0-126012583ea0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150177 Aug 03 09:50:36.022294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 930/1736] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:36.672389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:36.674527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:36.681645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:36.682087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:36.682833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:36.683257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:36.711299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c60beae-0297-4534-bdcb-39448f0798f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Aug 03 09:50:36.711846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 807/1737] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:36.753232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:36.754215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:36.760676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:36.761157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:36.761913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:36.762345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:36.824722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:36.832509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c18935a6-93d5-42d8-9108-ca92e350cc91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082905 Aug 03 09:50:36.833174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 931/1738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:37.044497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:37.045157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:37.051321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.051777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.052531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.052987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.186126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:37.194848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:37.196363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:37.197548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00e12870-81b9-47dc-92d6-b1fd87a82cd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156905 Aug 03 09:50:37.198112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 808/1739] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:37.724316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:37.726478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:37.732552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.733139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.733904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.734342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.764259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-42ecc36e-a174-4b01-925a-bba3d5eae270 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Aug 03 09:50:37.764919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 932/1740] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:37.854773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:37.855375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:37.861810 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.862246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.863020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:37.863481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:37.923588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:37.931036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-18b3cb22-b903-4c52-a310-237f4d334719 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080087 Aug 03 09:50:37.931600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 809/1741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:38.221233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:38.221847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:38.227907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.228353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.229145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.229579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.361406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:38.370434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:38.372086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:38.373307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-74c9ff9b-64e9-479d-bf60-75e7bce0866c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156079 Aug 03 09:50:38.373873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 933/1742] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:38.776670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:38.778822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:38.786039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.786494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.787253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.787684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.817040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-956b3af6-00f4-423e-b750-0875af32bf4d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Aug 03 09:50:38.817613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 810/1743] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:38.952068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:38.952673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:38.959317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.959811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.960565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:38.961023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:38.982278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:39.030967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:39.037477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9df94e37-d312-4189-b76c-d5dad73eba06 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.089232 Aug 03 09:50:39.038089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 934/1744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:39.397816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:39.398406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:39.405440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:39.406230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:39.407132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:39.407566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:39.558180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:39.568200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:39.569742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:39.570907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0eb1e1fe-7e7f-4916-bcd2-f75e8bffe709 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.177046 Aug 03 09:50:39.571467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 811/1745] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:39.829382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:39.831425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:39.837777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:39.838218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:39.838965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:39.839391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:39.869509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e6747299-e51a-47ce-9919-c942557315e2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Aug 03 09:50:39.870065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 935/1746] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:40.061356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:40.062090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:40.068466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.068943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.069700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.070127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.129975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:40.137370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bbd4cee1-229f-4b5a-a71d-7226657ee933 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079858 Aug 03 09:50:40.137926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 812/1747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:40.599775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:40.600384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:40.606830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.607271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.608018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.608445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.739400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:40.748093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:40.749687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:40.750859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cedb1793-f4ba-4dee-abb0-3d092a3e9449 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154886 Aug 03 09:50:40.751559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 936/1748] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:40.881956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:40.884117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:40.890711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.891160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.891912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:40.892345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:40.920618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c592c051-0ff4-497a-9c1d-e1c27acfface tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Aug 03 09:50:40.921191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 813/1749] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:41.159026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:41.160113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:41.166238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.166682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.167431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.167856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.228992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:41.236361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e17271d-a917-4e97-aa59-f7162eadafbd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081310 Aug 03 09:50:41.236945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 937/1750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:41.775856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:41.776457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:41.782452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.782895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.783649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.784080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.909125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:41.917413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:41.918930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:41.920072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3a7309e-86ec-4f87-894a-5865e0bb058f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148175 Aug 03 09:50:41.920625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 814/1751] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:41.933188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:41.935447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:41.942771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.943216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.943967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:41.944405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:41.972882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8fc47d8f-82ce-4347-b576-df85d3dee1d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Aug 03 09:50:41.973424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 938/1752] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:42.257968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:42.258573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:42.264490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.264952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:42.265697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.266117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:42.326480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:42.334643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8f4b2e4a-8132-413a-8ea8-216cf2372e50 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080521 Aug 03 09:50:42.335200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 815/1753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:42.943371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:42.943934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:42.950537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.951003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:42.951782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.952208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:42.984212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:42.986388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:42.993089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.993535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:42.994302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:42.994730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:43.024346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-953bcc53-4b45-4380-9b06-c3bae943420e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Aug 03 09:50:43.024936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 816/1754] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:43.083072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:43.091587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:43.093141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:43.094309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd0cc0be-4c0c-4aa9-8e4a-3d6eac811146 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155288 Aug 03 09:50:43.094866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 939/1755] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:43.355737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:43.356343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:43.362324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:43.363445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:43.364199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:43.364623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:43.427244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:43.434616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21f7b6fb-95bd-4aea-9c6a-4043d92e4c7d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082808 Aug 03 09:50:43.435172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 817/1756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:43.500910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:50:43.501090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:50:44.036369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:44.038547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:44.045261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.045703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.046451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.046880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.078266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3ad4f6b4-7bf6-4957-9812-fbeb5a683f82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Aug 03 09:50:44.078819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 940/1757] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:44.118101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:44.118709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:44.125221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.125668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.126425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.126858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.259935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:44.268324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:44.270017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:44.271168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-334b23e4-b9f0-40ee-bd65-2c0ecea15b0a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157096 Aug 03 09:50:44.271719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 818/1758] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:44.456656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:44.457281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:44.463198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.463633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.464380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:44.464806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:44.524395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:44.531810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e2e4b931-07f8-4f88-b1ad-40528b0fd7e0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079039 Aug 03 09:50:44.532362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 941/1759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:44 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:45.091112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:45.093179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:45.099445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.099885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.100635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.101093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.130579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-09162c80-60ba-4ec7-874b-a0eb131b1bbd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043456 Aug 03 09:50:45.131193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 819/1760] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:45.295035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:45.295640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:45.302883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.303336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.304095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.304524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.535843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:45.544360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:45.545883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:45.548595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b26314fb-b930-4898-b958-7ab5f44d9a41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.257471 Aug 03 09:50:45.549329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 942/1761] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:45.553217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:45.553829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:45.560160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.560608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.561400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:45.561832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:45.624654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:45.635613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d975637-64a3-4ba9-aeb3-5142068c29bc tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086468 Aug 03 09:50:45.636338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 820/1762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:46.142864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:46.145634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:46.151641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.152084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.152850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.153279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.181907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8d636514-3ffb-4601-b229-15fc1703ca05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042987 Aug 03 09:50:46.182449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 943/1763] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:46.571887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:46.572498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:46.579043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.579486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.580243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.580675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.599424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:46.656500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:46.657141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:46.664424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.664894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.665681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:46.666110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:46.713783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:46.723713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:46.725719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:46.726679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-256577ae-d970-4021-beda-c808f2e3d953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158658 Aug 03 09:50:46.727314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 821/1764] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:46.727734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:46.735230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b5d460bd-e07c-47d9-a0a3-facb2c10061c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082673 Aug 03 09:50:46.735780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 944/1765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:47.194436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:47.196582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:47.202619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.203067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.203820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.204250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.232833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5e6d3d47-9b7f-4bfa-9169-05310b114265 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Aug 03 09:50:47.233392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 822/1766] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:47.750350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:47.750967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:47.755887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:47.756551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:47.758403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.758848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.759610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.760043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.762991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.763443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.764210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:47.764650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:47.825758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:47.833795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5daaff62-e6c2-4c6a-8c26-df81c0d9e950 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082374 Aug 03 09:50:47.834491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 823/1767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:50:47.897717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:47.906240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:47.907773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:47.908979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6e8deda9-1b2a-46d3-8746-13d1be15ea90 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.162648 Aug 03 09:50:47.909576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 945/1768] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:48.245298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:48.247464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:48.254010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.254465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:48.255223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.255653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:48.284125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-23e9fe41-055e-4cb9-b77b-f4ed2fc7be9e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042784 Aug 03 09:50:48.285881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 824/1769] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:48.857532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:48.858144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:48.865464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.865913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:48.866663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.867092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:48.930194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:48.931559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:48.932202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:48.937758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2455840f-cd9a-47a1-b9a9-ab270c39a7c6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084068 Aug 03 09:50:48.938317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 946/1770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:48.938666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.939118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:48.939891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:48.940322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:49.071610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:49.079883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:49.081465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:49.082613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-78af595a-083d-44fc-86a7-4aba28f1582f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154942 Aug 03 09:50:49.083164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 825/1771] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:50:49.297829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:49.300620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:49.306608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:49.307050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:49.307799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:49.308220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:49.336407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-182a924e-4e1e-4df6-9dc5-60b0d305f7e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Aug 03 09:50:49.336974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 947/1772] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:49.958614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:49.959226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:49.965629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:49.966071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:49.966825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:49.967256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:50.032303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:50.040566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8da9307d-c6a3-4f2c-ae7a-8c3dedd95488 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086123 Aug 03 09:50:50.041161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 826/1773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:50.105093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:50.105699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:50.112131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:50.113258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:50.114006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:50.114431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:50.241566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:50.249892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:50.251403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:50.252631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f105208-1a23-493c-8b6f-21094e0244d9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151477 Aug 03 09:50:50.255269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 948/1774] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:50.348129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:50.350314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:50.356385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:50.356859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:50.357622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:50.358056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:50.387318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-87d463a9-2122-4f24-a1d9-42c9c5a175dd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Aug 03 09:50:50.387867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 827/1775] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:51.062388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:51.063004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:51.069449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.069892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.070641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.071071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.134381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:51.141848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e23cb42d-c00c-4c9f-bd8b-6518f0ef4ebf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083384 Aug 03 09:50:51.142408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 949/1776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:51.275809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:51.276417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:51.282906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.283352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.284111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.285257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.400036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:51.402183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:51.408129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.408624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.410011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:51.410679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:51.414297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:51.422754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:51.424270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:51.425732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-91d05512-d09a-4aec-a51c-72a0856ae63a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153769 Aug 03 09:50:51.426319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 828/1777] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:51.439785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a89a03f-6126-440e-a8e9-4ea027c7b41e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043658 Aug 03 09:50:51.440566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 950/1778] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:52.164275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:52.164984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:52.170949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.171387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.172138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.172562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.233835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:52.241242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0612d67c-78ab-42ac-9ba2-99ab179de86f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081914 Aug 03 09:50:52.241834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 829/1779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:52.448928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:52.449542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:52.451424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:52.453622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:52.456118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.456560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.457553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.457982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.460176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.460625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.461425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:52.461860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:52.461972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:52.492859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d978a97-09d4-4ae0-a0e5-85ec0142a3a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045298 Aug 03 09:50:52.493423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 830/1780] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:52.584564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:52.592980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:52.594489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:52.595640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71029272-62dc-46dc-b819-c3a4de99e4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150686 Aug 03 09:50:52.596198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 951/1781] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:53.262950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:53.263558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:53.270403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.270842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.271603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.272035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.335392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:53.342905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0adeb1e-1fd9-4e24-a1b5-52d9666af45c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083793 Aug 03 09:50:53.343473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 831/1782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:53.505361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:53.507561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:53.514010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.514454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.515208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.515647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.545445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3027e3ac-776a-4b69-b445-690e57123126 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 03 09:50:53.545993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 952/1783] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:53.618805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:53.619435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:53.625312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.625748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.626493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:53.626914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:53.751866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:53.760797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:53.762310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:53.763463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee9684ba-45f2-45c8-818f-25fa9292ea17 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148469 Aug 03 09:50:53.764013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 832/1784] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:54.364135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:54.364738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:54.370887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.371327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.372071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.372497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.432867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:54.440197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bbeeef3c-6971-4444-b130-39890ffd8e38 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080569 Aug 03 09:50:54.441475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 953/1785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:54.557508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:54.559619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:54.566053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.566490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.567526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.567949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.596355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a867b64-ab19-4daa-93cd-8db5eba194ee tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Aug 03 09:50:54.597586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 833/1786] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:54.787564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:54.788162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:54.794663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.795110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.795855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:54.796279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:54.927814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:54.936294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:54.937822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:54.938972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b72d0418-ca6d-4fc2-93fc-6965c90b65ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155801 Aug 03 09:50:54.939517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 954/1787] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:55.462653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:55.463189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:55.465085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=86 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:55.470405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.470841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:55.471881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.472341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:55.533286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:55.540773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8789178f-5121-45c5-8c77-4eaae23d77da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082156 Aug 03 09:50:55.541357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 834/1788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:55 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:55.609289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:55.611407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:55.618016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.618458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:55.619198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.619621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:55.650513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b15f397-aa65-4917-909b-353d5a224ca4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045052 Aug 03 09:50:55.651077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 955/1789] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:55.962199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:55.962811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:55.969404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.969848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:55.970611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:55.971044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:56.101225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:56.109578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:56.111083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:56.113025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca9c7bca-1f2f-4e72-80d0-5c7a38c921e5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153995 Aug 03 09:50:56.113605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 835/1790] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:56.561628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:56.562238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:56.564523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:56.570354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:56.570841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:56.571572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:56.572000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:56.632594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:56.639913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-183fa841-246f-457f-b5c2-c2c436ec1f16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082150 Aug 03 09:50:56.640477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 956/1791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:56.663356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:56.665494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:56.671708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:56.672157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:56.672949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:56.673382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:56.702831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5fa10839-d1a1-4327-804d-cb07624e9cfa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 Aug 03 09:50:56.703381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 836/1792] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:57.136444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:57.137097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:57.143166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.143633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.144395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.144831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.271376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:57.279658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:57.281183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:57.282331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c3fe60b-e39c-49e2-8b3d-47809036d84b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149813 Aug 03 09:50:57.282881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 957/1793] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:57.661437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:57.662049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:57.668511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.669208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.669819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.671290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.715597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:57.717902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:57.725026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.725554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.726388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:57.726895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:57.732322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:57.739909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9b786246-998a-4f44-83e8-a96a8d203adf tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082359 Aug 03 09:50:57.740481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 837/1794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:57.758532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c5fa51a-0188-4809-b57f-14394066c22e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046849 Aug 03 09:50:57.759083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 958/1795] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:58.306134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:58.306664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:58.312783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.313279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.314029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.314464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.318860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:50:58.438853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:58.448039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:58.449578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:58.450744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a373cd0b-4a00-4824-b72f-e81f9847edf3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148621 Aug 03 09:50:58.451300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 838/1796] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:58.761275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:58.761884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:58.768272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.768884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.769663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.770071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.770844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:58.772992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:58.779481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.779943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.780693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:58.781141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:58.810713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-af48edfe-4eda-47c6-9caf-a541852e34f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Aug 03 09:50:58.811275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 839/1797] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:50:58.835162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:58.842655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b92f2d14-5cd7-4032-b038-9cfbd015550c tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085264 Aug 03 09:50:58.843210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 959/1798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:50:59.474422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:59.475024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:59.481163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.481605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.482356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.482778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.615248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:59.623647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:59.625180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:59.626350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bf8a3667-c1ea-4c69-8e57-0b5c931c4452 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155856 Aug 03 09:50:59.626911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 840/1799] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:50:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:50:59.822660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:59.824752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:59.831335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.831810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.832601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.833063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.861985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-513be609-c712-4252-aeaa-76276fe1e43f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 Aug 03 09:50:59.863406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 960/1800] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:50:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:50:59.864912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:50:59.865622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:50:59.872079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.872515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.873300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:50:59.873733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:50:59.936047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:50:59.944306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9b20b848-a670-473e-9e04-12134900dc98 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084695 Aug 03 09:50:59.945822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 841/1801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:50:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:00.650267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:00.650865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:00.656924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.657367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:00.658108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.658533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:00.787588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:00.796347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:00.798497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:00.800274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01153d82-4e09-4f17-a21a-6275a342ff40 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153353 Aug 03 09:51:00.801066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 961/1802] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:00.874411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:00.876563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:00.883197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.883647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:00.884408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.884868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:00.914537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61b652e4-82e9-45ff-a43e-e3af99312a75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 03 09:51:00.915028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 842/1803] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:00.965656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:00.966259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:00.973261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.973702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:00.974452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:00.974881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:01.035432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:01.042889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3aa937c1-1f0a-4a40-ab01-60165e963e91 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081032 Aug 03 09:51:01.043449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 962/1804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:01.823709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:01.824303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:01.830335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:01.830772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:01.831514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:01.831975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:01.926817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:01.929351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:01.935377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:01.935825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:01.936582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:01.937041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:01.960955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:01.966591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5f3ec46-9919-494a-9d26-d8e5efd23504 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Aug 03 09:51:01.967146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 963/1805] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:01.969441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:01.970944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:01.972102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8186c289-54d7-418e-bb9b-bce0ce059f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152328 Aug 03 09:51:01.973209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 843/1806] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:02.063836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:02.064464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:02.071139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:02.071583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:02.072327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:02.072752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:02.133327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:02.140672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-083fb164-bdf8-405c-b944-68633724a1d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080667 Aug 03 09:51:02.141261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 964/1807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:02 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:02.978788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:02.980933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:02.987394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:02.987868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:02.988625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:02.989078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:02.994845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:02.995602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:03.001864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:03.002385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:03.003249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:03.004348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:03.021194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce852479-ab60-4984-bdec-d8422ea31cf9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 Aug 03 09:51:03.021770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 844/1808] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:03.135702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:03.144581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:03.146264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:03.147413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3c9a76df-5a30-4b9b-8065-822ffb78c759 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156466 Aug 03 09:51:03.147968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 965/1809] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:03.162682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:03.163301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:03.169328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:03.169777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:03.170539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:03.170973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:03.234262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:03.241918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f96b0d79-d365-4640-87cc-26b825f9a074 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083604 Aug 03 09:51:03.242474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 845/1810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:03 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:03.888457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:51:03.888684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:51:04.033932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:04.036728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:04.042813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.043288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.044046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.044480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.074376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6210a660-66e9-442f-98bb-040a0d50c52c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Aug 03 09:51:04.074929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 966/1811] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:04.170740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:04.171281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:04.177869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.178307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.179054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.179483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.262358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:04.262978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:04.269781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.270290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.271089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:04.271522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:04.308915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:04.318205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:04.319721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:04.320912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21da230e-3967-4cf1-becc-a39592cb766f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154285 Aug 03 09:51:04.321471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 846/1812] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:04.336606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:04.340008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:04.344797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-538cf79b-a127-4fc3-b824-430fa9c7b3eb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086343 Aug 03 09:51:04.345380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 967/1813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:04 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:05.086031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:05.088148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:05.094186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.094629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.095381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.095808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.124978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3468592a-8d12-4cc1-8468-b264e5aada61 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Aug 03 09:51:05.125519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 847/1814] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:05.343844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:05.344382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:05.352106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.352582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.353364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.353797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.366418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:05.367030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:05.373381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.373830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.374593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:05.375027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:05.436588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:05.444938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-548a436f-1997-4c97-8e81-974ab2011046 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082623 Aug 03 09:51:05.445514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 848/1815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:05 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:05.485385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:05.494315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:05.495810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:05.496975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26a0600b-e0c4-47c0-ac19-4c80d0ee5f80 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157355 Aug 03 09:51:05.497523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 968/1816] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:06.137459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:06.139645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:06.146458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.146905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.147668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.148100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.176985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-387db121-04be-4b1d-b1ae-9de37b83b65e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Aug 03 09:51:06.177540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 849/1817] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:06.466774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:06.467387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:06.474683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.475127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.475887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.476320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.521744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:06.522352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:06.528771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.529247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.530006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:06.530442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:06.537884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:06.545298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d47f9442-c72b-4982-8a8e-715c9bf37b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082318 Aug 03 09:51:06.546186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 969/1818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:06 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:06.661599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:06.670069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:06.671568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:06.672719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2621c52b-58f7-4746-ace3-e8b7a001ed97 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155668 Aug 03 09:51:06.673309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 850/1819] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:07.189112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:07.192111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:07.198189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.198632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.199378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.199816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.228324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-296a7586-77a1-49b6-b7d4-b45d6736d763 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Aug 03 09:51:07.228890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 970/1820] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:07.566721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:07.567577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:07.574078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.574526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.575285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.575730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.636490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:07.643927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35329a83-5ad7-4a48-b4dc-14e4f488d926 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081617 Aug 03 09:51:07.644516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 851/1821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:07 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:07.696301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:07.696934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:07.703357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.703803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.704554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:07.705022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:07.839049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:07.847718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:07.849254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:07.850401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-657e5829-c509-40d9-9209-2ea90c187cd6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158210 Aug 03 09:51:07.850949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 971/1822] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:08.241140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:08.243283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:08.249708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.250164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:08.250931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.251395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:08.280209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a1d7cc1e-2eaf-4a1c-bd77-e27580eaa649 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Aug 03 09:51:08.280744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 852/1823] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:08.664741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:08.665378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:08.671387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.671823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:08.672564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.673023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:08.734738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:08.743056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f5ddcc6-66b5-48b9-a08d-116e7be76fa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082178 Aug 03 09:51:08.743616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 972/1824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:08 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:08.874183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:08.874781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:08.881902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.882338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:08.883080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:08.883517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:09.010845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:09.019297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:09.020798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:09.021975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9eb39387-a1bf-4fe8-b7d8-302823411569 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151688 Aug 03 09:51:09.022536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 853/1825] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:09.293109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:09.295228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:09.301633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:09.302083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:09.302847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:09.303287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:09.333227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-38e4a40a-bfa7-4f3b-970d-beeedc7eacf0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Aug 03 09:51:09.333768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 973/1826] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:09.763941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:09.764548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:09.771237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:09.771674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:09.772414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:09.772858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:09.836722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:09.840146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:09.845034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-26cc7085-19cc-4dce-a339-41b61e461281 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084892 Aug 03 09:51:09.845602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 854/1827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:09 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:10.045554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:10.046133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:10.053800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.054250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.055009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.055442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.187379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:10.197044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:10.198567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:10.199735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd7c43f9-ba50-4d9d-b60e-ea367972962d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158224 Aug 03 09:51:10.200302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 974/1828] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:10.345668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:10.347745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:10.354341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.354780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.355530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.355956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.384603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a67b963-3520-4d9c-82e4-8214c50d02db tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043009 Aug 03 09:51:10.385186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 855/1829] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:10.866992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:10.867609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:10.873623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.874078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.874831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:10.875273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:10.938887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:10.947268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4e9be9fe-c12d-42b9-aadc-aea2e67015e3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084946 Aug 03 09:51:10.947834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 975/1830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:10 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:11.222668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:11.223278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:11.229371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.229817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:11.230573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.231004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:11.360416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:11.369124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:11.370608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:11.371748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d85b1c0-409a-464b-a349-92a6dbef8c2c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153044 Aug 03 09:51:11.372295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 856/1831] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:11.397128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:11.399264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:11.405667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.406112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:11.406865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.407295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:11.437427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-70c64589-4eae-4a89-a557-0d905f9e36e3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Aug 03 09:51:11.437969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 976/1832] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:11.969148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:11.969750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:11.976909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.977354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:11.978110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:11.978541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:12.038894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:12.046337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9cffec9c-0747-406c-b6a8-d5bc5f97b272 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081114 Aug 03 09:51:12.046898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 857/1833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:11 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:12.395152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:12.395764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:12.401927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:12.402485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:12.403121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:12.403559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:12.449967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:12.452124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:12.459202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:12.459654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:12.460422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:12.460887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:12.490876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f148938-671e-4ce2-ae83-55fc4fd0148e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Aug 03 09:51:12.491440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 858/1834] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:12.538256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:12.546628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:12.548146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:12.549407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-890a8c40-47da-4058-bc23-43adaea9a4b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158707 Aug 03 09:51:12.550064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 977/1835] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:13.068425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:13.069058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:13.075066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.075508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.076258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.076688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.136563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:13.144013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dfa92326-e79d-46e1-a8a2-d83bbbbe8dd3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080356 Aug 03 09:51:13.144585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 859/1836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:13 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:13.502765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:13.505685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:13.512195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.512640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.513422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.513858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.544010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1eccae6f-43d5-4330-aa9a-90334fa1bb9c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Aug 03 09:51:13.544553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 978/1837] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:13.573188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:13.573794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:13.580280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.580726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.582137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:13.582574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:13.710191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:13.718486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:13.719977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:13.721153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bdb5a51a-acae-4e0b-8579-90812073f385 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151809 Aug 03 09:51:13.721702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 860/1838] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:14.164749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:14.165393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:14.171424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.171878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.172639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.173104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.234143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:14.241747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9d20a719-f5cb-4efb-8898-a1474803328d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081018 Aug 03 09:51:14.242309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 979/1839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:14 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:14.556673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:14.558792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:14.564751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.565290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.566057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.566483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.595154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2e7f1c2d-8f08-4da9-8113-06b6ab90f45b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042440 Aug 03 09:51:14.595773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 861/1840] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:14.744475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:14.745151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:14.751132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.751574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.752319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:14.752748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:14.879258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:14.887629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:14.889158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:14.890308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-304cba91-5223-4624-8607-8515824f8765 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149748 Aug 03 09:51:14.890874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 980/1841] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:15.263092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:15.263694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:15.269984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.270418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:15.271163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.271586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:15.333092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:15.340435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c6edbefc-4f8f-4f81-b78a-f9ed037a03f9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081218 Aug 03 09:51:15.341022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 862/1842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:15 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:15.607754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:15.609898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:15.616540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.617015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:15.617765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.618193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:15.649380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c71b3af-b45a-41ff-a9dc-1bc133bca212 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Aug 03 09:51:15.649932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 981/1843] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:15.914106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:15.914653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:15.921062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.921511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:15.922266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:15.922700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:16.052112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:16.060521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:16.062043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:16.063191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c3cfe85-8cbb-4c8f-952f-cfba3178e6c4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154016 Aug 03 09:51:16.063741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 863/1844] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:16.362247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:16.363104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:16.369161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:16.369610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:16.370370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:16.370808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:16.430843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:16.438308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7f5a848-7859-4d56-9cb6-368d5fb0bd71 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.079986 Aug 03 09:51:16.438872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 982/1845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:16 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:16.662070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:16.664143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:16.670309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:16.670753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:16.671506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:16.671933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:16.701619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6859bad3-d4b1-4fb1-b78d-14f8c8036cb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Aug 03 09:51:16.702167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 864/1846] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:17.087485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:17.088126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:17.094921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.095365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.096112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.096540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.226965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:17.235300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:17.236830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:17.238204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5871c303-0a6f-44cb-876c-fd9941f2d982 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154640 Aug 03 09:51:17.238751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 983/1847] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:17.460539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:17.461177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:17.467548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.467989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.468741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.469198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.531196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:17.539610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f29ee5e0-8447-4684-a8c3-9f1c2ce0849b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083121 Aug 03 09:51:17.540166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 865/1848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:17 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:17.714301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:17.716374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:17.723057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.723505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.724271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:17.724710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:17.741084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:17.754558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc28a0c0-28f1-4def-a1fc-9eea5de493a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Aug 03 09:51:17.755107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 984/1849] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:18.261841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:18.262449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:18.268606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.269091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.269854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.270285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.399093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:18.407298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:18.408782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:18.410585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b5f9bb0-82de-460e-bbe6-774a66712f5e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152686 Aug 03 09:51:18.411137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 866/1850] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:18.559680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:18.560291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:18.567542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.567989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.568741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.569202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.629975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:18.637394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c8d95cf-f102-4f11-8242-651f78b4a94d tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081607 Aug 03 09:51:18.637946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 985/1851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:18 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:18.767098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:18.769339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:18.775753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.776191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.776977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:18.777405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:18.806671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f51d8422-3f84-4ced-8346-a9462695938d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 03 09:51:18.807209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 867/1852] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:19.433529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:19.434143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:19.440189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.440642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.441427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.441863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.573699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:19.582793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:19.584309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:19.585496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-705c3e9c-7a47-4fe0-b1ad-ea586b1dc3ab tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155901 Aug 03 09:51:19.586055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 986/1853] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:19.658837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:19.659437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:19.665339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.665779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.666521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.666944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.728260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:19.735805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a7e8caa7-a843-4c77-a3be-0e9e1cffa05f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080794 Aug 03 09:51:19.736370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 868/1854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:19 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:19.818479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:19.820650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:19.826625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.827068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.827815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:19.828241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:19.858761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d75a4f6d-9578-40d1-b4b6-2af8e10bdc4a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Aug 03 09:51:19.859305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 987/1855] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:20.608519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:20.609148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:20.616341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.616785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.617561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.617989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.748755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:20.757876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:20.758484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:20.758612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:20.760070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:20.761256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be613d3a-57b9-45b9-af0d-60f9fda5c09b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156779 Aug 03 09:51:20.761815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 869/1856] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:20.765147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.765665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.766432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.766870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.828515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:20.839195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9369827d-5bfe-4be1-a687-cbcbadf273a9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085988 Aug 03 09:51:20.839959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 988/1857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:20 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:20.871372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:20.873508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:20.879964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.880408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.881190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:20.881625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:20.910515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-424fec97-ca9e-4ae6-b321-b29030384d91 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042782 Aug 03 09:51:20.911209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 870/1858] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:21.785373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:21.785965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:21.792515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.793000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.793753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.794191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.860944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:21.861870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:21.869481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.869922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.870682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.871365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.889911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:21.924216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:21.933765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:21.934381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:21.935277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:21.936443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72c7ba3a-04e5-4928-b444-9bd67606ff7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155513 Aug 03 09:51:21.937024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 989/1859] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:21.942867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:21.943122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3399c38b-225e-444f-ab9e-650632dfd153 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.086118 Aug 03 09:51:21.943806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 871/1860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:21 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:21.945145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:21.950986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.951436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.952195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:21.952632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:21.985507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ac8718c-a85e-4047-96d1-94c0b32b5250 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Aug 03 09:51:21.986062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 990/1861] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:22.961020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:22.961617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:22.963597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:22.964209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:22.968080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:22.968523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:22.969304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:22.969727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:22.970682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:22.971129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:22.972516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:22.972987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:23.043640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:23.055781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1f681e89-41cd-4168-8a99-a83f26d5edf8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.095898 Aug 03 09:51:23.062841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 991/1862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:22 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:23.063302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:23.066586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:23.073135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:23.073587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:23.074348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:23.074800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:23.104709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3f831ca-99ba-4f7c-ad15-2f0f1faaef1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045645 Aug 03 09:51:23.105309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 992/1863] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:23.116742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:23.125075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:23.126596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:23.127728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8dd2e4c-ee5c-4abc-be65-94a00769a020 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.170729 Aug 03 09:51:23.129072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 872/1864] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:24.078527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:24.079136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:24.086147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.086588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.087343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.087768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.117080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:24.119221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:24.125879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.126520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.127292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.128998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.153424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:24.162161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-535f6614-7600-4b24-b79b-429d1d7a528e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.087345 Aug 03 09:51:24.162757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 993/1865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:24 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:24.167597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:24.168215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:24.174680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.175659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.176450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:24.176922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:24.312161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f551db6e-d9db-44fd-a6af-c6be88177f03 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199137 Aug 03 09:51:24.312726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 873/1866] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:24.312919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:24.322424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:24.323917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:24.325081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-427ab3d0-bfc8-4343-b302-94b5e530bac0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.161378 Aug 03 09:51:24.325626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 994/1867] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:25.183790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:25.184390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:25.191681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.192426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.193656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.193656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.254327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:25.262116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be37e5e4-8379-4f7f-9a80-22837d07bfa0 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082170 Aug 03 09:51:25.262664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 874/1868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:25 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:25.325105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:25.327150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:25.334368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.334816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.335568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.335998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.349157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:25.349772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:25.355716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.356156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.356957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:25.357393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:25.366702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-afc0bf6b-739f-44f1-adfb-871e145aa542 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Aug 03 09:51:25.367273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 995/1869] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:25.482614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:25.491099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:25.492599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:25.493779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-69fc9915-2a1d-42af-b3c7-7806fe7e9ad0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148576 Aug 03 09:51:25.494332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 875/1870] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:26.282335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:26.282940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:26.289542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.289989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.290731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.291161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.354649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:26.362278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0bba6269-f662-4ec3-9b22-d6a3fa85cd7b tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083784 Aug 03 09:51:26.362876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 996/1871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:26 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:26.378675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:26.380829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:26.383162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=84 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:26.388343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.388791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.389569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.390000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.419563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-62e4adfe-cd02-4324-b7fb-532ffff45ad7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Aug 03 09:51:26.420107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 876/1872] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:26.517408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:26.518026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:26.524068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.524515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.525316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:26.525756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:26.657879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:26.666262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:26.667773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:26.668963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1bc358e3-261a-4eff-a59e-4baec7c530e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155488 Aug 03 09:51:26.669532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 997/1873] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:27.383022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:27.383633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:27.390127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.390573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.391323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.391754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.431793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:27.434112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:27.436475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=84 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:27.441823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.442558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.443311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.443740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.452648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:27.461235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b568e05c-420e-4c71-a86d-3db23107773e tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082049 Aug 03 09:51:27.461795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 877/1874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:27 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:27.474292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e04d44f1-b689-467c-ab61-f3d53a5145e7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046351 Aug 03 09:51:27.474849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 998/1875] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:27.692768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:27.693324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:27.699270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.699709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.700456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:27.700907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:27.829284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:27.838099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:27.839614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:27.840775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ec456c5a-3303-407c-b092-8a6bdaf2311e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152251 Aug 03 09:51:27.841349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 878/1876] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:28.483928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:28.484544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:28.486634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:28.489456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:28.491885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.492338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:28.493131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.493574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:28.495894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.496331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:28.497105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.497532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:28.527787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f669edca-7724-4646-b5f9-3be7ce6a710f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Aug 03 09:51:28.528347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 879/1877] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:28.555288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:28.562792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e5aee62d-4139-475e-8d51-f339f74716f5 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082736 Aug 03 09:51:28.563355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 999/1878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:28 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:28.865636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:28.866269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:28.872639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.873107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:28.873863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:28.874290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:29.001665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:29.010040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:29.011534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:29.012673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3eec3028-0284-4971-8551-83b0f7796fdf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151652 Aug 03 09:51:29.013248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 880/1879] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:29.584154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:29.585225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:29.591660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:29.592108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:29.592889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:29.593323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:29.659941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:29.668002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c2e1675-a98e-426a-b851-a5aeae2eca4f tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.088376 Aug 03 09:51:29.668846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 881/1880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:29 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:29.676892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:29.679175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:29.685342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:29.685818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:29.686546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:29.686980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:29.716090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f11873d-f2dc-4080-a54b-04ac8f5eb592 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179357 Aug 03 09:51:29.716641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1000/1881] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:30.035837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:30.036435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:30.042360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.042800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.043544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.043968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.226952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:30.235202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:30.236724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:30.238029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77a08b8e-7307-4ebf-8ec6-1f1848deaabb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.206803 Aug 03 09:51:30.238578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 882/1882] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:30.689710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:30.690711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:30.698004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.698455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.699220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.699656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.703582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:30.728531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:30.730695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:30.738352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.738871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.739639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:30.740119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:30.761859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:30.769512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b25f240b-6d67-4fa3-b8a2-b87b89c9e069 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083457 Aug 03 09:51:30.770079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1001/1883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:30 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:30.770352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-65b20278-589d-4c78-a3f5-20089a596dc4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045636 Aug 03 09:51:30.771103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 883/1884] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:31.261219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:31.261826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:31.267767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.268210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.269704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.270136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.405758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:31.414966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:31.416476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:31.417669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c70c5345-b346-43d2-a6bb-da94a85dd331 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160309 Aug 03 09:51:31.418294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1002/1885] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:31.782747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:31.785056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:31.790404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:31.791019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:31.791497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.791938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.792717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.793168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.797526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.797967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.798749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:31.799175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:31.824480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c348a702-be9a-4d95-b245-99e6bd7ae844 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 03 09:51:31.825067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 884/1886] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:31.861534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:31.869712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8fcda9b0-d2e5-40a6-9306-bff66fb5b7cd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083088 Aug 03 09:51:31.870287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1003/1887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:31 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:32.441250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:32.441845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:32.448080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.448515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.449292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.449717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.575297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:32.583597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:32.585138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:32.586286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-69dc6a6c-d22b-4db4-91e1-ab8d87433ca6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149548 Aug 03 09:51:32.586836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 885/1888] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:32.837518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:32.839716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:32.846179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.846800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.847868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.848308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.876629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fbb98d99-7376-4e92-92ea-40cb61e8f079 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Aug 03 09:51:32.877202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1004/1889] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:32.890246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:32.890860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:32.897923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.898373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.899150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:32.899568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:32.963338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:32.970872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92bd3cee-9f89-45b1-ab17-c18b12b52b78 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084482 Aug 03 09:51:32.971437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 886/1890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:32 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:33.609580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:33.610196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:33.616474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:33.616956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:33.617712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:33.618152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:33.748084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:33.756430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:33.757975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:33.759129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f4f02eb9-ab40-40b6-be09-3c7eb36b9951 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153480 Aug 03 09:51:33.759691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1005/1891] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:33.889438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:33.891510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:33.897953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:33.898396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:33.899149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:33.899578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:33.928034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-645cb103-ca72-4735-a032-661259f24017 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042573 Aug 03 09:51:33.928576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 887/1892] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:33.991712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:33.992335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:33.998787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:33.999230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:33.999986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:34.000420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:34.070198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:34.077836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6349398f-2e02-417b-b942-3db229631db7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.090590 Aug 03 09:51:34.078400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1006/1893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:33 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:34.782594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:34.783202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:34.789874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:34.790319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:34.791072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:34.791504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:34.795492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:34.917951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:34.927060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:34.928543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:34.929759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-342d51c4-a2dc-49dc-a1cf-ef8edb134789 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151083 Aug 03 09:51:34.930316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 888/1894] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:34.939512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:34.942539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:34.948488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:34.949043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:34.949796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:34.950228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:34.979201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1df3614b-0991-4caf-87a6-6188161aed59 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Aug 03 09:51:34.979746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1007/1895] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:35.099258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:35.099860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:35.105797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:35.106238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:35.106991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:35.107416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:35.169034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:35.176648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc95014b-40f2-42af-bb05-3d7d58070ca1 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081740 Aug 03 09:51:35.177237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 889/1896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:35 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:35.953072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:35.953646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:35.961128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:35.961567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:35.962312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:35.962737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:35.990635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:35.992974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:35.999551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:35.999997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:36.000756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:36.001207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:36.031603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bde3d085-bd75-4f0b-9203-897ff71e72b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044994 Aug 03 09:51:36.032846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 890/1897] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:36.094445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:36.102813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:36.104305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:36.105484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d144470-a70f-48cf-b8a4-5f6d9eb27461 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156448 Aug 03 09:51:36.106038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1008/1898] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:36.198215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:36.198827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:36.204936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:36.205323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:36.206072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:36.206501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:36.269063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:36.276626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5bd92bc4-3e99-40d1-b065-17f75bf05c81 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082305 Aug 03 09:51:36.277266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 891/1899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:36 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:37.044734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:37.046890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:37.053811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.054279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.055471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.055471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.085550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-972fce13-d541-4c6a-81f9-7fe28924f8fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 03 09:51:37.086099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1009/1900] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:37.129691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:37.130291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:37.136784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.137251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.138001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.138427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.268839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:37.277936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:37.279421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:37.280561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bc54e2f9-0e04-46d9-9db0-f9e459ba6b88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155111 Aug 03 09:51:37.281147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 892/1901] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:37.297394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:37.297942 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:37.303892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.304337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.305128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:37.305563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:37.366842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:37.374172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a113025-7c44-4a58-8975-851b15f593fd tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080669 Aug 03 09:51:37.374725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1010/1902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:37 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:38.098419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:38.100546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:38.106668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.107107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.107853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.108279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.136935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-623e4a65-2856-4183-b5bc-f956ce4452ba tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Aug 03 09:51:38.137532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 893/1903] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:38.305370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:38.305926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:38.312284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.312723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.313512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.313941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.395751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:38.396363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:38.402352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.402799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.403558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:38.403988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:38.450352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:38.459003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:38.460557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:38.461696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9264413b-f2f5-46b6-b4f0-50167cdb4c4d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.161962 Aug 03 09:51:38.462498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1011/1904] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:38.465432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:38.473068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b54dff0-59fa-4461-9591-dc04577a7604 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081309 Aug 03 09:51:38.473635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 894/1905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:38 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:39.151779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:39.153953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:39.160884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.161340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.162118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.162554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.197453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ea342ed-4493-46d7-bcda-d702afb2f10e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051155 Aug 03 09:51:39.198317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1012/1906] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:39.484928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:39.485556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:39.493057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.493501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.493920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:39.494416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.494519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:39.494898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.501100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.501553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.502313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:39.502746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:39.576595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:39.585958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89325e3d-ac81-4675-93b3-2e4c3eb1b1ce tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.096016 Aug 03 09:51:39.586549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1013/1907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:39 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:39.651389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:39.660619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:39.662575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:39.663748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f9d6a764-ac71-4a65-9310-2449ee9e6ba8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.183394 Aug 03 09:51:39.664378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 895/1908] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:40.210670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:40.212709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:40.218819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.219261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.220003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.220520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.249834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5ceaf8f-85df-4983-a40b-447986cac9f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Aug 03 09:51:40.250373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1014/1909] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:40.608009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:40.608620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:40.615298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.615732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.616483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.616933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.676834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:40.684185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a814ff65-1d1a-48d8-a650-c9ba50ffc0c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080178 Aug 03 09:51:40.684737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 896/1910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:40 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:40.689111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:40.689830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:40.696898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.697514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.698302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:40.698738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:40.832501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:40.841237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:40.842732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:40.843883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7c5ff36a-33f8-45af-9ddb-b0d0dc1bed13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158673 Aug 03 09:51:40.844435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1015/1911] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:41.261382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:41.263517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:41.270284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.270724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:41.271472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.271897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:41.299444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-23b81600-bf24-446f-bff5-a257409b36ce tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 Aug 03 09:51:41.299981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 897/1912] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:41.705434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:41.705981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:41.712417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.712925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:41.713695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.714133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:41.778952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:41.787162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3d1a7ad2-b969-42d2-bd6c-4f2a70bf3dc3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085699 Aug 03 09:51:41.787734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1016/1913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:41 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:41.870584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:41.871195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:41.877671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.878181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:41.879526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:41.879956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:42.007618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:42.015929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:42.017461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:42.018616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-381e61bd-f23f-4329-8f2b-1ad9c5cc8d4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154935 Aug 03 09:51:42.019714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 898/1914] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:42.312198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:42.314315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:42.321262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:42.321716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:42.322481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:42.322946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:42.347220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:42.352302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8afd85d3-b700-4e65-a5f6-34bca6ce9caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Aug 03 09:51:42.352878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1017/1915] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:42.807877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:42.808516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:42.814564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:42.815005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:42.815758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:42.816855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:42.877902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:42.886291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7575628a-d2d7-4536-a82d-8bfa1d8f25e9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082274 Aug 03 09:51:42.886853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 899/1916] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:42 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:43.042178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:43.042779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:43.049298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.049743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.050801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.051283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.179431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:43.187837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:43.189357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:43.190517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-858024e0-de71-4409-9217-8d13beab9215 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152540 Aug 03 09:51:43.191619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1018/1917] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:43.364245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:43.366435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:43.372422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.372901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.373661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.374093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.403622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab18dd4b-2182-4a81-88be-8ea803a6e83d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Aug 03 09:51:43.404097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 900/1918] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:43.907609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:43.908211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:43.914912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.915361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.916097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:43.916522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:43.977772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:43.985038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-845e96a0-d309-49d8-8759-cb0dbcec3b20 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081248 Aug 03 09:51:43.985622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1019/1919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:43 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:44.215468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:44.216009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:44.223097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:44.223741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:44.224496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:44.224954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:44.354323 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:44.362599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:44.364253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:44.365451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-615977b2-79c2-4a43-bd96-61d3de1c423b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153963 Aug 03 09:51:44.366010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 901/1920] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:44.416770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:44.418929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:44.424965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:44.425976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:44.427429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:44.427870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:44.456772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-513a9535-d98e-48d9-8317-904a1d7a8fc0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044023 Aug 03 09:51:44.457508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1020/1921] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:45.007333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:45.007938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:45.014019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.014454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.015200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.015628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.077677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:45.085078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-50c20e8b-e363-4004-85e5-c3b8cd52b132 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082119 Aug 03 09:51:45.085635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 902/1922] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:45 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:45.387677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:45.388498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:45.394894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.395408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.396230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.396663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.469373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:45.471622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:45.479270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.479717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.480479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:45.480938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:45.511606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4723774d-1790-41cb-a7a8-cd09132280fd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046275 Aug 03 09:51:45.512221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 903/1923] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:45.621446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:45.630595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:45.632113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:45.633431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6ccaba43-2a59-4f00-8d78-cdb90e82df74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.249756 Aug 03 09:51:45.633907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1021/1924] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:46.106292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:46.106897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:46.112944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.113387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.114134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.114556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.174457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:46.178637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:46.183104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b54e426-c5db-46fd-a23d-0c025c6f72d8 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.080671 Aug 03 09:51:46.183660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 904/1925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:46 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:46.524380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:46.526421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:46.532838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.533318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.534060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.534528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.563879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5217ebac-acd6-4564-b28d-e53a79399a1e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Aug 03 09:51:46.564423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1022/1926] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:46.657996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:46.658596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:46.665401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.665848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.666609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:46.667044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:46.797768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:46.806095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:46.807603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:46.808765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-00a37d66-92e1-4e60-b251-7c449e5dc9f5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155098 Aug 03 09:51:46.809357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 905/1927] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:47.204603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:47.205251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:47.212532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.213021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.213783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.214213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.275398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:47.282813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-37d9e77e-b264-42a3-88a8-dd1766a37279 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082038 Aug 03 09:51:47.283376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1023/1928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:47 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:47.576777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:47.578988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:47.585714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.586157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.586911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.587341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.616732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cc365c48-4e3a-4dae-876a-07b903de8c64 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 03 09:51:47.617303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 906/1929] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:47.832020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:47.832542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:47.839682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.840127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.840911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:47.841343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:47.971113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:47.979551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:47.981077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:47.982232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4fed0edc-eeaa-4157-8a13-3d69fd102103 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154343 Aug 03 09:51:47.982784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1024/1930] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:48.303622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:48.304236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:48.311289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:48.311760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:48.312517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:48.312979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:48.376328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:48.383949 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d587683-c94d-4538-a7f0-094d6be66316 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084330 Aug 03 09:51:48.384510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 907/1931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:48 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:48.629527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:48.631677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:48.637734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:48.638182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:48.638939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:48.639372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:48.667659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ccd213e3-9e56-45d5-9dea-556e50e1954f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 Aug 03 09:51:48.668200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1025/1932] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:49.006227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:49.006782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:49.012744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.013219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.013981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.014411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.141113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:49.150035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:49.151515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:49.152659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8d84b16-c11c-43e4-b6e1-34321ddd5343 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151509 Aug 03 09:51:49.153234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 908/1933] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:49.405100 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:49.405724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:49.412139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.412572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.413340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.413765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.475941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:49.483515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-26d58a16-e0c3-49f6-910d-eb5b82215138 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082265 Aug 03 09:51:49.484082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1026/1934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:49 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:49.680563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:49.682694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:49.689294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.689743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.690504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:49.691644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:49.720316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c75dd33-0418-4815-bc25-e6c367c79ca3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Aug 03 09:51:49.720884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 909/1935] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:50.175027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:50.176698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:50.182800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.183244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.183997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.184428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.319171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:50.327507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:50.329050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:50.330211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-09373e38-ed0b-43a8-aaa5-b9a0ff89c8be tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159073 Aug 03 09:51:50.330761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1027/1936] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:50.505215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:50.505815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:50.511774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.512222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.513001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.513428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.575880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:50.583799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d653505-8cbd-408d-87bc-997670f85a47 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082530 Aug 03 09:51:50.584349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 910/1937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:50 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:50.731502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:50.733700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:50.740280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.740725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.741527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:50.741964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:50.771994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32a0e16c-f9fe-403a-9b45-3ed6cb8ec4b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 03 09:51:50.772551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1028/1938] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:51.354078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:51.354760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:51.361171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.361618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.362384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.362817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.489320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:51.497740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:51.499277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:51.500439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3d444956-da02-4786-8fbe-6307ac24c807 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150442 Aug 03 09:51:51.501021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 911/1939] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:51.603855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:51.604527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:51.610470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.610920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.611674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.612112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.675734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:51.684379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b64e6136-5b2b-43f4-843e-d5a65c90f0ee tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084381 Aug 03 09:51:51.684966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1029/1940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:51 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:51.784138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:51.786470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:51.792422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.792779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.793558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:51.793988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:51.823373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b7ea9fd-c000-4790-b087-aa07ce1dd127 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043251 Aug 03 09:51:51.823915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 912/1941] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:52.524265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:52.524931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:52.531511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.531960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:52.532718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.533167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:52.663143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:52.671791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:52.673336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:52.674489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8b1e5576-89a8-4ad3-b05f-fc34ff2c6a74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154871 Aug 03 09:51:52.675041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1030/1942] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:52.705761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:52.706367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:52.713301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.713747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:52.714510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.714940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:52.776382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:52.783749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eb3c62be-1a84-4232-9a27-8c16fb049057 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081884 Aug 03 09:51:52.784312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 913/1943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:52 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:52.835749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:52.837892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:52.843844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.844292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:52.845074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:52.845508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:53.022316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fb1c74b-8ebf-41ec-821b-2c0d01933350 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190791 Aug 03 09:51:53.022853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1031/1944] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:53.698755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:53.699354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:53.705377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:53.705816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:53.706568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:53.707000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:53.805147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:53.805764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:53.812464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:53.812946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:53.813721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:53.814157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:53.877675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:53.885515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a219ffb-52e7-4fc5-bd70-238b9b0964da tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.084780 Aug 03 09:51:53.886097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1032/1945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:53 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:54.034893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:54.037709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:54.044027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:54.044480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:54.045288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:54.045726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:54.077520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5290026b-4489-4d70-b967-c57d192c20f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046753 Aug 03 09:51:54.078076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1033/1946] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:54.080103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:54.089425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:54.090935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:54.092093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fbbdcd38-074d-4fa4-bdb5-19f51bd8ceef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.397460 Aug 03 09:51:54.092734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 914/1947] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:54.906733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:54.907342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:54.914439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:54.914948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:54.915680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:54.916117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:54.933716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:54.977783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:54.985147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3cc7bd0d-a503-4d91-a697-00d96e1e40d7 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082302 Aug 03 09:51:54.985691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1034/1948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:54 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:55.091025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:55.093243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:55.100087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:55.100540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:55.101338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:55.101772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:55.116012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:55.116619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:55.122646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:55.123083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:55.123820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:55.124250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:55.131925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad9dfaed-6dbd-4d2d-8030-57018d847377 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Aug 03 09:51:55.132493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 915/1949] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:55.254968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:55.263518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:55.265050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:55.266204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-18238ec7-e6f6-471b-95e1-9df11543d9aa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154759 Aug 03 09:51:55.266753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1035/1950] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:51:56.005921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:56.006532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:56.012572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.013057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.013826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.014261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.075350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:56.082965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45bec5b0-bf4d-4680-8503-7f71a7c99e16 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.081042 Aug 03 09:51:56.083647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 916/1951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:56 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:56.143577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:56.145726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:56.152672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.153148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.153901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.154334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.184758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6d23822-b824-419d-8722-02ce3ca149bc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Aug 03 09:51:56.185336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1036/1952] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:56.289773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:56.290414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:56.296923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.297392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.298136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:56.298572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:56.425724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:56.434753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:56.436269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:56.437467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7cdea8ad-c4d0-45e0-b0d2-4b54bd6fd500 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152101 Aug 03 09:51:56.438026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 917/1953] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:57.110776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:57.111381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:57.117652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.118091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.118831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.119261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.182283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:57.189721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ededf739-95fa-4cdc-a654-f66eea9148c9 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082766 Aug 03 09:51:57.190277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1037/1954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:57 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:57.197831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:57.199981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:57.201861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=84 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:57.207280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.207731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.208527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.208963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.237639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-57ae38e7-e32a-45f2-b635-3d74cce23474 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Aug 03 09:51:57.238199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 918/1955] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:57.461712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:57.462315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:57.464245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=80 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:57.469573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.470015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.470758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:57.471184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:57.603103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:57.611419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:57.612949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:57.614109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c47306ca-ca78-4f6e-91ed-60254f9debac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157036 Aug 03 09:51:57.614662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1038/1956] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:58.212904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:58.213539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:58.219901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.220334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.221106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.221542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.250335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:58.252615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:58.260279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.260762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.261561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.261997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.285868 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:58.292614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7fe3e26-9f5b-454f-b8ba-5e157ae77da0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046127 Aug 03 09:51:58.293404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1039/1957] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:51:58.293534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-42422b30-b3c1-427e-874d-3d94f83acef3 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.085053 Aug 03 09:51:58.293878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 919/1958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:58 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:51:58.636980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:58.637589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:58.643578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.644025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.644777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:58.645235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:58.772502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:58.780766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:58.782292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:58.783461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-309ced7f-9e0c-47e5-aa27-1b8aac2b053c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150404 Aug 03 09:51:58.784006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1040/1959] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:51:59.305110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:59.307320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:59.313616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:59.314055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.314231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:59.314360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.315091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.315521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.321179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.321661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.322421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.322850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.344899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8019ed0c-cf27-4dcb-af7e-5e63d6aac205 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043742 Aug 03 09:51:59.345456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 920/1960] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 09:51:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:51:59.384616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:59.392112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cea9d397-a108-480a-9b8c-45672837267a tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.082276 Aug 03 09:51:59.392670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1041/1961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:51:59 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:51:59.806692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:51:59.807290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:51:59.813227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.813666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.814416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:51:59.814841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:51:59.832670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:51:59.942148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:59.951053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:59.952959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:51:59.954411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51b6f03d-60fa-4a9e-8ff0-4bf96b0aa8ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152163 Aug 03 09:51:59.955016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 921/1962] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:51:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:00.357270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:52:00.359482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:00.367086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.367538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:00.368293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.368729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:00.414079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:00.414693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [instance: 0ab003f4-e418-44ec-93fe-e0d109021fcc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:00.421206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.421656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:00.422418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.422854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:00.451671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-441ae066-a72a-49e9-9b11-96d46872a551 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action" status: 200 len: 76611 microversion: 2.1 time: 0.098130 Aug 03 09:52:00.460566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1042/1963] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 09:52:00 2022] POST /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c/action => generated 76611 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:52:00.485462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb2ba828da0f4ea583a7c6e5471bf2df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0f1be2882b542668029c26092bd87b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:00.493066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a56586ca-cf7d-4e09-8c34-323bac2665bb tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc" status: 200 len: 1217 microversion: 2.1 time: 0.083361 Aug 03 09:52:00.493629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 922/1964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:52:00 2022] GET /compute/v2.1/servers/0ab003f4-e418-44ec-93fe-e0d109021fcc => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:52:00.665490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-37a5801b-bd33-4480-87e1-534ec86fdee6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] Calling method '.version_select at 0x7fb998ce0af0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:00.669875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37a5801b-bd33-4480-87e1-534ec86fdee6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [11a00356-7273-4be8-a3ae-59ec0dcb8025] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 09:52:00.978174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:00.978710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:00.984973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.985420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:00.986184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:00.986623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:01.116227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:01.124445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:01.126006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:01.127159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4a56aa75-4f67-40f8-87c2-91895e3b7884 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153652 Aug 03 09:52:01.127711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 923/1965] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:01.676695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [None req-37a5801b-bd33-4480-87e1-534ec86fdee6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] [11a00356-7273-4be8-a3ae-59ec0dcb8025] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 40750. Aug 03 09:52:01.696305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-37a5801b-bd33-4480-87e1-534ec86fdee6 tempest-TestShelveInstance-161482265 tempest-TestShelveInstance-161482265-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-586809750" status: 202 len: 0 microversion: 2.1 time: 1.035636 Aug 03 09:52:01.696898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1043/1966] 10.222.0.20 () {58 vars in 1251 bytes} [Wed Aug 3 09:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-586809750 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:52:02.150677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:02.151318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:02.157760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:02.158207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:02.158960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:02.159396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:02.293208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:02.301840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:02.303862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:02.305760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-343f6a08-ece9-45bf-bcf8-dcd436c33853 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159436 Aug 03 09:52:02.306338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 924/1967] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:03.330249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:03.330879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:03.337639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:03.338103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:03.338900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:03.339342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:03.549280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:03.558508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:03.560056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:03.561272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08424631-589c-449e-a1be-1c1c092e8227 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.235563 Aug 03 09:52:03.562001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1044/1968] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:04.583654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:04.585759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:04.593837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:04.595029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:04.595907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:04.596416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:04.738434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:04.748267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:04.749742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:04.750910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fb8a54d5-99f3-4a05-a06b-6c8e76ac5fb9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.171201 Aug 03 09:52:04.751475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 925/1969] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:05.774647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:05.775358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:05.781903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:05.782349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:05.783097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:05.783524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:05.917952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:05.926949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:05.928805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:05.930007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c50b50f-d1de-4d45-a101-a13a8a1ebf7f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159972 Aug 03 09:52:05.944836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1045/1970] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:06.953140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:06.953833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:06.964097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:06.965053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:06.966643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:06.967257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:07.103206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:07.112082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:07.113621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:07.114817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb9792df-68c4-4dfe-91f6-d88c91128f1c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.165785 Aug 03 09:52:07.116044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 926/1971] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:08.138107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:08.139368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:08.150126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:08.150577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:08.151347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:08.151789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:08.289176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:08.297783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:08.299288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:08.300670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d011f40d-1cef-45a1-8abd-3ed2240e54a6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.166941 Aug 03 09:52:08.301655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1046/1972] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:09.325706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:09.326314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:09.332900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:09.333353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:09.334797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:09.335246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:09.484035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:09.493365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:09.494904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:09.496081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb390b29-97c7-47e3-bc8c-648858a13592 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.175190 Aug 03 09:52:09.496647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 927/1973] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:10.521650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:10.522945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:10.529386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:10.529832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:10.530592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:10.531021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:10.779295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:10.789717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:10.791717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:10.792966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e0e32e3-0835-4e8b-9e4e-ffb3fbcd0079 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.275178 Aug 03 09:52:10.793525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1047/1974] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:11.822812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:11.824022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:11.830963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:11.831412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:11.832189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:11.832623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:12.003837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:12.019370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:12.027333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:12.029072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1ac36e73-671f-47d1-98a8-0080eb7e4d76 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.214336 Aug 03 09:52:12.046899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 928/1975] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:13.054092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:13.054731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:13.072640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:13.073122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:13.073900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:13.074341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:13.286167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:13.296868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:13.298627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:13.300677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-908bf6ee-a3b9-47a0-951b-2e942331e953 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.251445 Aug 03 09:52:13.308858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1048/1976] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:14.326444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:14.327316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:14.334691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:14.335141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:14.336086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:14.336523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:14.766983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:14.778009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:14.780712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:14.788999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bab8bcf5-0b2d-4ce3-8c5d-fa5c48e77a22 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.461342 Aug 03 09:52:14.789828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 929/1977] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:15.813686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:15.814418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:15.822933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:15.823087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:15.823847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:15.824281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:16.029520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:16.042184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:16.045084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:16.046982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-213f64ae-e6d8-4203-980a-9865734b8f6b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.237772 Aug 03 09:52:16.066382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1049/1978] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:17.072040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:17.073396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:17.093091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:17.093789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:17.094813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:17.095709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:17.434859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:17.447506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:17.455758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:17.459070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-07a5a519-7e1f-4435-accd-26db27679d48 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.391329 Aug 03 09:52:17.461877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 930/1979] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:18.482171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:18.483497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:18.490699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:18.491313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:18.492153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:18.492841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:18.675240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:18.685419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:18.687099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:18.688416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-607940fc-c4ac-4712-a9c5-f614366f03e9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.210182 Aug 03 09:52:18.689781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1050/1980] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:19.131460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51ee7083-74e4-4fc7-87c1-21871d2634f9 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] Action: 'create', calling method: .version_select at 0x7fb998b3a280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-285943997", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtxPgSSr3GQPcuahamtR00urouT48a+xfD9Z4ZJXvQZqwJLmyHYd2IOjJiN0qV2N6x0Z2UVhpsNDwr8dX35QR2z3xpSZexc8zVBLS611qsGbAbpVsEgGmO4eQBaCHmbqA=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:52:19.149379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-51ee7083-74e4-4fc7-87c1-21871d2634f9 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] Getting quotas for project ee5ea3c75f2f4c4bb5b3f13783028de0. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:52:19.153454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-51ee7083-74e4-4fc7-87c1-21871d2634f9 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] Getting quotas for user da5e2866f8074991830ba286ea738376 and project ee5ea3c75f2f4c4bb5b3f13783028de0. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:52:19.180305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51ee7083-74e4-4fc7-87c1-21871d2634f9 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.225379 Aug 03 09:52:19.181041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 931/1981] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 09:52:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:52:19.716563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:19.717972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:19.726125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:19.727257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:19.728051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:19.728488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:19.876228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:19.885672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:19.887172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:19.888326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b4d17a2f-0239-4c13-93ee-89c071bdcc47 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.176232 Aug 03 09:52:19.888901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1051/1982] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:20.585275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:52:20.585522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:52:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:52:20.912206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:20.913026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:20.919717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:20.920161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:20.921010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:20.921439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:21.055516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:21.064387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:21.066849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:21.068479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1f5d3cbf-c587-49bf-9ad9-f98ff79efb57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160727 Aug 03 09:52:21.069454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 932/1983] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:22.091685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:22.092396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:22.098941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:22.099384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:22.100710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:22.101355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:22.119987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:22.239791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:22.248331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:22.249865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:22.251011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c5ae417e-bc4a-4a81-a0d7-c4c1022ffc21 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.163288 Aug 03 09:52:22.251555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1052/1984] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:23.274907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:23.275551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:23.281934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:23.282382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:23.283181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:23.283611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:23.417438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:23.425797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:23.427295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:23.428445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3985d568-e42d-473d-b38d-f5f1561ba4c9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157990 Aug 03 09:52:23.429078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 933/1985] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:24.452071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:24.452688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:24.459410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:24.459861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:24.461963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:24.462403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:24.591473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:24.599778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:24.601893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:24.603049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-21616606-53a3-4dc5-b79f-e0c15fd04088 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154906 Aug 03 09:52:24.603600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1053/1986] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:25.625148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:25.625750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:25.632922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:25.633391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:25.634147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:25.634574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:25.766911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:25.776013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:25.777550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:25.778701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-001ab206-60a0-4a85-9fb4-fa3ca44c49e3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157489 Aug 03 09:52:25.779250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 934/1987] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:26.802427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:26.803040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:26.810365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:26.810807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:26.811557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:26.811985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:26.943371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:26.951732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:26.953308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:26.954460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2117796a-85d9-40fd-995a-1e261c754240 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156003 Aug 03 09:52:26.955014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1054/1988] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:26 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:27.977643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:27.978281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:27.980588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:27.985841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:27.986286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:27.987044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:27.987478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:28.117109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:28.125436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:28.126950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:28.128114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-97a7f3dd-5546-4c16-8f50-7f6ba0778950 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154656 Aug 03 09:52:28.128658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 935/1989] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:29.151974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:29.152572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:29.154979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:29.160610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:29.161074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:29.161820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:29.162249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:29.293971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:29.302411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:29.304038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:29.305208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fe150f56-f779-4573-8c21-a8ce12e3850e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157578 Aug 03 09:52:29.305754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1055/1990] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:30.330106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:30.447375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:30.447981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:30.453908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:30.454353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:30.455109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:30.455540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:30.459436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=81 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:30.582746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:30.591424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:30.592980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:30.594120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8965f057-1839-4ddc-b63f-02f1549d1387 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.269056 Aug 03 09:52:30.594675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 936/1991] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:31.618109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:31.618720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:31.625183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:31.625650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:31.626403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:31.626834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:31.753316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:31.761629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:31.763126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:31.764262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ee2182a1-a81b-41cb-9f6b-820311549da8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150758 Aug 03 09:52:31.764801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1056/1992] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:32.787590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:32.788190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:32.795383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:32.795829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:32.796587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:32.797051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:32.930612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:32.938976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:32.940488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:32.941677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-943c712f-a662-4e0a-9169-f43ca0361ecd tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158026 Aug 03 09:52:32.942237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 937/1993] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:33.965098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:33.965693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:33.972074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:33.972557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:33.973328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:33.973754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:34.104048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:34.112335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:34.113858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:34.115000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c304ac7-006d-42be-91ac-76a57bbb0114 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154026 Aug 03 09:52:34.115549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1057/1994] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:35.137962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:35.138563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:35.145064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:35.145498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:35.146249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:35.146677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:35.279457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:35.287823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:35.290264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:35.291425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-36924cc1-ff52-4e79-ae64-c3418d537467 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157344 Aug 03 09:52:35.291987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 938/1995] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:36.314809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:36.315340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:36.322675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:36.323119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:36.323872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:36.324303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:36.452570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:36.461986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:36.463489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:36.464628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54ab0f13-abbe-429b-8423-33f73132afe0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153856 Aug 03 09:52:36.465211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1058/1996] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:37.486730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:37.487367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:37.495051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:37.495505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:37.496272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:37.496707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:37.630969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:37.639880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:37.641402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:37.642563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df19b7d1-4d5d-4285-98cd-efed95f03e73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159867 Aug 03 09:52:37.643089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 939/1997] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:38.666659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:38.667260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:38.673708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:38.674178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:38.674919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:38.675325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:38.806274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:38.814646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:38.816139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:38.817331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-23469f52-7b77-4132-9d40-a0e7db13e306 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155413 Aug 03 09:52:38.818132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1059/1998] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:39.840591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:39.841209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:39.847732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:39.848171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:39.849040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:39.849467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:39.980327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:39.988796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:39.990319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:39.992158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df460628-3d08-4c27-ab4c-8eb37a685194 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154753 Aug 03 09:52:39.992718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 940/1999] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:39 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:41.015022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:41.015616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:41.022110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:41.023108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:41.023936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:41.024362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:41.153986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:41.162179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:41.164420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:41.165592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9a80114d-5793-46e3-a88e-eb93098c80de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154489 Aug 03 09:52:41.166152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1060/2000] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:42.189077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:42.189689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:42.197303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:42.197752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:42.198518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:42.198955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:42.333599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:42.342593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:42.344082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:42.345258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bcb48e40-f59b-4072-ba5e-190c523def2e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160265 Aug 03 09:52:42.345808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 941/2001] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:42.733681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:52:42.733907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:52:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:52:43.368496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:43.369168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:43.375607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:43.376052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:43.376801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:43.377253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:43.507882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:43.516192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:43.517722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:43.518860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-094b5a8d-c560-4d83-80b7-54845c6b7904 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155113 Aug 03 09:52:43.519408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1061/2002] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:44.542037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:44.542641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:44.549440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:44.549905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:44.550652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:44.551079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:44.682228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:44.690474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:44.691971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:44.693414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f34b40f4-113a-47be-9237-59e1af626820 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155158 Aug 03 09:52:44.693955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 942/2003] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:45.717173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:45.717779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:45.723963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:45.724409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:45.725201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:45.725735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:45.857144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:45.865810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:45.868251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:45.869466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-adc30a78-d5f6-4e1c-94d0-23487e478bb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156247 Aug 03 09:52:45.870020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1062/2004] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:46.892992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:46.893591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:46.900766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:46.901241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:46.902000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:46.902440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:47.029407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:47.037744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:47.040031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:47.041221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9941aeaa-7cd0-4725-81d4-7d5041f44aa6 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152198 Aug 03 09:52:47.041781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 943/2005] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:46 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:48.064293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:48.065503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:48.073529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:48.074010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:48.074880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:48.075315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:48.202762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:48.212047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:48.213598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:48.214758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1350550d-ec01-4a39-bca9-6eaa94eed562 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154447 Aug 03 09:52:48.215304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1063/2006] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:49.238135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:49.238740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:49.245825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:49.246273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:49.247046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:49.247486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:49.379016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:49.387264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:49.388757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:49.389922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-883a3134-0c0a-4306-b611-51c6834c5b28 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155698 Aug 03 09:52:49.390475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 944/2007] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:50.412941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:50.414053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:50.420587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:50.421066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:50.421827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:50.422294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:50.553278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:50.562505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:50.564028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:50.566940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83ff36d2-e96b-494b-9fc0-9f704ef94d73 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156192 Aug 03 09:52:50.567505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1064/2008] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:51.590878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:51.591518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:51.598029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:51.598481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:51.599245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:51.599683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:51.727761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:51.736071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:51.737593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:51.738737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f80a642-d59e-416d-bf09-e83b90a0172c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151824 Aug 03 09:52:51.739289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 945/2009] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:52:52.760770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:52.761404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:52.768086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:52.768528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:52.769314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:52.769743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:52.773652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=75 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:52.900066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:52.908368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:52.909940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:52.911120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5685e5c6-5e52-408a-9a47-1fdf64ddcd37 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154357 Aug 03 09:52:52.911666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1065/2010] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:52 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:53.934815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:53.935417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:53.941587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:53.942022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:53.942768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:53.943468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:54.075910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:54.084127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:54.086401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:54.087528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4caf6fbd-d9b2-44ce-b6df-b4050e6bbe8b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156699 Aug 03 09:52:54.088080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 946/2011] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:55.111282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:55.111889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:55.119366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:55.119813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:55.120578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:55.121042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:55.253742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:55.262638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:55.264161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:55.265354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ba11b03-b9b9-4532-9454-2d132c5fd7d1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157932 Aug 03 09:52:55.265913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1066/2012] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:56.291154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:56.291793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:56.298660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:56.299106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:56.299879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:56.300312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:56.427970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:56.437127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:56.438617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:56.439769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab7c2c2c-b5f7-4254-9ecd-788fc7511cad tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154128 Aug 03 09:52:56.440320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 947/2013] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:57.463027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:57.463662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:57.470115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:57.470562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:57.471306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:57.471733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:57.599441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:57.608416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:57.609940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:57.611080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08f9d45c-a829-4e1a-8fb9-79834b5bf72c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152206 Aug 03 09:52:57.611632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1067/2014] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:58.635128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:58.635730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:58.638054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:58.643395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:58.643836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:58.644587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:58.645040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:58.771441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:58.780092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:58.781618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:58.782769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84dd5c6f-c2c7-4cbf-87e5-4073e6503208 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152116 Aug 03 09:52:58.783317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 948/2015] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:52:59.805927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:52:59.806546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:52:59.808902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=26 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:52:59.814305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:59.814748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:59.815493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:52:59.815920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:52:59.943892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:59.953466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:59.954810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:52:59.956010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-21f758c4-9612-4f42-90e8-f8f12551613a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154412 Aug 03 09:52:59.956912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1068/2016] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:52:59 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:00.980544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:00.981178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:00.987739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:00.988186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:00.988970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:00.989403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:00.992473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=78 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:01.122841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:01.131244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:01.133200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:01.134357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92dadfba-80cc-4da4-b302-c7d5e98c5e32 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158606 Aug 03 09:53:01.134921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 949/2017] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:02.158121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:02.158726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:02.166180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:02.166622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:02.167375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:02.167808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:02.300072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:02.308790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:02.310380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:02.311527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-68e71493-c1d6-46df-9a30-33f0205b5b62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157407 Aug 03 09:53:02.312108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1069/2018] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:03.336050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:03.336609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:03.343168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:03.343616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:03.344375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:03.344824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:03.470466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:03.479387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:03.480899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:03.482042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-76f6fba9-12b9-4e3a-84e2-b5ed0b743d55 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150720 Aug 03 09:53:03.482599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 950/2019] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:04.505024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:04.505638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:04.512341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:04.512852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:04.513617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:04.514055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:04.639350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:04.647635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:04.649159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:04.650296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c3e73628-a6de-4f08-9d4a-2a1d2b450672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149357 Aug 03 09:53:04.650843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1070/2020] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:05.673667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:05.674280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:05.680887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:05.681333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:05.682089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:05.682519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:05.811726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:05.821093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:05.822603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:05.823759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3538e68-a350-4116-8b4b-8f2ee05fc1c7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154033 Aug 03 09:53:05.824316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 951/2021] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:05 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:06.845680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:06.846200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:06.852920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:06.853388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:06.854123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:06.854556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:06.985036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:06.993858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:06.995371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:06.996523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e512111-ce86-4ca1-abaa-157f75ab2f41 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154794 Aug 03 09:53:06.997111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1071/2022] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:08.020273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:08.020905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:08.027789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:08.028229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:08.029019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:08.029451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:08.159214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:08.167616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:08.169118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:08.170262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e704e516-2bc4-4260-90ab-0af002ab3f3c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153930 Aug 03 09:53:08.170817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 952/2023] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:09.195626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:09.196232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:09.202722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:09.203175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:09.203935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:09.204373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:09.330911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:09.340126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:09.341671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:09.342829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b1d6a8a-704b-49ea-b9d1-0a5a6e4650c8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151970 Aug 03 09:53:09.343386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1072/2024] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:10.366136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:10.367488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:10.374159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:10.374600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:10.375350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:10.375775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:10.501576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:10.510040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:10.511532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:10.512678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f43eaf38-8190-4a57-9e86-87bd5c84e7ae tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150446 Aug 03 09:53:10.513255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 953/2025] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:11.535450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:11.536053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:11.542799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:11.543246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:11.544004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:11.544440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:11.674871 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:11.683749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:11.685322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:11.686467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f03afbce-1819-4378-a460-2bc05bfd2b57 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154971 Aug 03 09:53:11.687026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1073/2026] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:12.710688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:12.711332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:12.717899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:12.718346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:12.719106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:12.719539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:12.853563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:12.861837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:12.863327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:12.864473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7d7aae0b-3293-4c10-ba39-20f448796c9b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158234 Aug 03 09:53:12.865064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 954/2027] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:12 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:13.888085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:13.888675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:13.895151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:13.895596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:13.896350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:13.896861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:14.021514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:14.029791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:14.031321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:14.032469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ce2d605-4997-47f4-a1db-0e361c89811a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148461 Aug 03 09:53:14.033056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1074/2028] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:15.055895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:15.056616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:15.063201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:15.063645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:15.064411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:15.064864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:15.192706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:15.201490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:15.202977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:15.204119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-69a537a1-89a6-4b86-970a-084eab860c4c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152487 Aug 03 09:53:15.204672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 955/2029] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:16.228003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:16.228638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:16.235217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:16.235666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:16.236426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:16.236886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:16.364730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:16.374355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:16.375950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:16.377136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2cfb192a-70e9-4c6b-af26-d55ebedfb290 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153586 Aug 03 09:53:16.377864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1075/2030] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:17.400676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:17.401347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:17.407962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:17.408406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:17.409208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:17.409645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:17.539600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:17.548069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:17.549592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:17.550729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eb1d4693-6d58-47f0-a260-dcb45a908e50 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154397 Aug 03 09:53:17.551288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 956/2031] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:18.574641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:18.575158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:18.581572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:18.582014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:18.582755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:18.583182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:18.713630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:18.721939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:18.723440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:18.724575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9df1f64f-db03-4f8e-90be-f01750228e14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154457 Aug 03 09:53:18.725161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1076/2032] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:19.747687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:19.748320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:19.754825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:19.755272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:19.756031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:19.756468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:19.882492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:19.891554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:19.893091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:19.894318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2f7363e2-8e72-4a1d-9ab3-eb0862307107 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150581 Aug 03 09:53:19.894850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 957/2033] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:19 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:20.471429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a9cb288-d7d2-4c5a-b2d9-b76dfd643b37 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] Calling method '.version_select at 0x7fb99d3ebca0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:20.491980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a9cb288-d7d2-4c5a-b2d9-b76dfd643b37 tempest-TestVolumeBootPattern-1772559003 tempest-TestVolumeBootPattern-1772559003-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-285943997" status: 202 len: 0 microversion: 2.1 time: 0.024694 Aug 03 09:53:20.500651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1077/2034] 10.222.0.20 () {58 vars in 1260 bytes} [Wed Aug 3 09:53:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-285943997 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 09:53:20.918843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:20.919459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:20.925844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:20.926295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:20.927044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:20.927474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:21.113883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:21.122601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:21.124218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:21.125415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4603b034-9eef-48f1-ad1b-31cd0e302913 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.211309 Aug 03 09:53:21.125968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 958/2035] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:22.148112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:22.148728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:22.157842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:22.158292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:22.159066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:22.159502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:22.299770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:22.309432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:22.310961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:22.312184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d1a1f211-f795-431b-9df5-9ce2f2cca6e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.168223 Aug 03 09:53:22.312986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1078/2036] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:23.338074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:23.338749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:23.344989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:23.345431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:23.346198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:23.346625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:23.551674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:23.575212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:23.576855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:23.578163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-53207b8c-4a8e-4a2a-b75c-0e8ffe2e325e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.244539 Aug 03 09:53:23.589394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 959/2037] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:53:24.602231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:24.603085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:24.609601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:24.610052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:24.610808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:24.611241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:24.613836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:24.835204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:24.843834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:24.845376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:24.846522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-73f40aa2-87d4-41c2-81e3-20d4e56bc797 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.248354 Aug 03 09:53:24.847078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1079/2038] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:25.871500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:25.872114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:25.879069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:25.879581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:25.880356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:25.880791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:26.028715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:26.037797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:26.040355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:26.041813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-14c4ad13-6817-433a-8b89-d60264ffea53 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.174537 Aug 03 09:53:26.042782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 960/2039] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:27.072341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:27.072981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:27.079969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:27.080465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:27.081240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:27.081669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:27.222353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:27.231530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:27.233090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:27.234261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d6737717-5a31-45a5-ba6c-25aae20df457 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.166871 Aug 03 09:53:27.234815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1080/2040] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:28.258021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:28.259156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:28.265740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:28.266208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:28.266953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:28.267378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:28.401147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:28.409531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:28.411029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:28.412186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3c79026b-8745-424d-8226-a5052d41f672 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158168 Aug 03 09:53:28.412926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 961/2041] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:29.435765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:29.436370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:29.442868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:29.443319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:29.444345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:29.444780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:29.576578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:29.584941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:29.586996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:29.588176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-207c74b8-690e-482c-88a5-a99b6c5fde23 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156309 Aug 03 09:53:29.588744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1081/2042] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:30.611950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:30.612574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:30.614892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=28 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:30.620873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:30.621314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:30.622068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:30.622497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:30.749007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:30.757377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:30.758861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:30.760000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e32fff15-a784-4e17-8892-7817417f6b46 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151978 Aug 03 09:53:30.760564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 962/2043] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:31.783461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:31.784188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:31.786499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:31.792068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:31.792686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:31.793485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:31.793922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:31.931118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:31.939941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:31.941506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:31.942657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0690c0bf-304e-4a36-9138-cb4f87f8b2c3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.163298 Aug 03 09:53:31.943206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1082/2044] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:32.355615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:32.356233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:32.363363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.363785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:32.364885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.365497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:32.370201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=84 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:32.400693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:53:32.481731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9bf775d-6b48-4f87-b81f-eb091f70f67f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 204 len: 0 microversion: 2.1 time: 0.130509 Aug 03 09:53:32.482578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 963/2045] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:53:32 2022] DELETE /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:53:32.490937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:32.491556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:32.497981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.498607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:32.499439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.499902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:32.637915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:32.646382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-369b5c78-b56d-43f2-bcd0-ff360fadb085 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.159320 Aug 03 09:53:32.646997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1083/2046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:53:32.967928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:32.968619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:32.974611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.975055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:32.975806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:32.976236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:33.116556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:33.127754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:33.129316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:33.131118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e83f4f6f-27fb-4e5d-9b82-4d87ec3abd78 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.167175 Aug 03 09:53:33.131963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 964/2047] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:32 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:33.668017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:33.668610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:33.675105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:33.675552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:33.676305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:33.676739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:33.812477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:33.820671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b9822562-ac7f-43e9-9f67-96e973585cc0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156937 Aug 03 09:53:33.821261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1084/2048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:34.155875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:34.156511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:34.163650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:34.164101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:34.165619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:34.166058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:34.309785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:34.318064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:34.319822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:34.321400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-13ea493a-4ad2-43f7-8a22-36eec0a9b271 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.169105 Aug 03 09:53:34.321795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 965/2049] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:34.844479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:34.845112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:34.853000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:34.853579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:34.854376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:34.854821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:34.991419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:34.999563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8fe68911-b5e0-4ba6-bffc-c475454738c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158991 Aug 03 09:53:35.000123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1085/2050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:34 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:35.345221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:35.345807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:35.352221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:35.352892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:35.353647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:35.354076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:35.490575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:35.500983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:35.502694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:35.503883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bebb5342-de75-436a-a02e-7813c5f1855c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.162700 Aug 03 09:53:35.504438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 966/2051] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:53:36.021895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:36.022490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:36.029639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:36.030085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:36.030836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:36.031274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:36.170459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:36.178909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4065e8a-c892-453c-a4d5-2b7652b9ec33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.160835 Aug 03 09:53:36.179493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1086/2052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:36.528196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:36.528801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:36.535254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:36.535697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:36.536452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:36.536906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:36.680063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:36.688681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:36.690222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:36.691381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-06548224-fc40-45a0-96e7-59caf8154340 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.168142 Aug 03 09:53:36.691946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 967/2053] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:37.201063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:37.201637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:37.208483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:37.208966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:37.209732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:37.210161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:37.343720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:37.351707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a492bede-3577-40c5-8345-4498e90c5d06 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154685 Aug 03 09:53:37.352280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1087/2054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:37.716155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:37.716769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:37.723372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:37.723816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:37.724582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:37.725043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:37.861730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:37.871181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:37.872733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:37.873952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-69452e9a-9f57-4a89-a0f1-1320b0e47404 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.162225 Aug 03 09:53:37.874506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 968/2055] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:38.374339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:38.374949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:38.381580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:38.382028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:38.382786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:38.383244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:38.524567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:38.532834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-487151f2-1877-4884-a983-6ed0ccea9cfe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.162423 Aug 03 09:53:38.533402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1088/2056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:38.897814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:38.898370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:38.905291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:38.905790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:38.906598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:38.907079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:39.044906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:39.053608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:39.056408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:39.056954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1258a753-05f4-4c9d-88bf-e5e00dbabbea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.163144 Aug 03 09:53:39.057859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 969/2057] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:39.559782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:39.560344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:39.569285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:39.570022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:39.571937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:39.573363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:39.710941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:39.719563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd90b628-c44b-41f5-892d-3c749348a0b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.164411 Aug 03 09:53:39.720132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1089/2058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:40.080704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:40.081348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:40.088372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:40.088836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:40.089600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:40.090032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:40.225487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:40.235055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:40.236564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:40.237747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fb2f9421-1108-4cdb-ac76-47278fd0eb2b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.161018 Aug 03 09:53:40.238301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 970/2059] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:40.741287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:40.741919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:40.749122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:40.749572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:40.750335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:40.750767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:40.892744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:40.902516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-08eddc3a-ab64-4c27-9e2d-aa4abf91407b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.165084 Aug 03 09:53:40.903163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1090/2060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:41.261889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:41.262812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:41.270025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:41.270464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:41.271229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:41.271649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:41.442281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:41.451877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:41.453392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:41.454775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a691c9f6-a37d-408a-9eea-dc1ebe651e89 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.197890 Aug 03 09:53:41.455338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 971/2061] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:41.924938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:41.925549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:41.932548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:41.933024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:41.933773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:41.934204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:42.066772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:42.075462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-13e71aa2-120d-4f10-9385-ec690747faf9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154423 Aug 03 09:53:42.076021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1091/2062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:42.479946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:42.480575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:42.487110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:42.487560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:42.488315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:42.488743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:42.616874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:42.625234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:42.626739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:42.627894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0bb653fb-706a-4616-bba3-ddd43cbf5bfa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152784 Aug 03 09:53:42.628449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 972/2063] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:43.095512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:43.096127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:43.102835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:43.103286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:43.104402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:43.104858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:43.231386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:43.239290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-814097e4-2f7f-42fa-ac4f-d2ba831b35bf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147615 Aug 03 09:53:43.239853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1092/2064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:43.651211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:43.651798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:43.658288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:43.658732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:43.659489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:43.659922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:43.792700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:43.801050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:43.802540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:43.803682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a7d8e09-3490-41b4-94ee-a6cffb109ea8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156804 Aug 03 09:53:43.804237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 973/2065] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:44.261545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:44.262148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:44.268205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:44.268649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:44.269424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:44.269854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:44.399892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:44.407785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0fc7d87e-d2e5-4829-9fc9-154fbbe87124 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150956 Aug 03 09:53:44.408381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1093/2066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:44.828114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:44.828741 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:44.835275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:44.835714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:44.836462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:44.836998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:44.964878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:44.973296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:44.974799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:44.975956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9ced0097-4341-4e22-9be1-1ba90f7e1fe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151800 Aug 03 09:53:44.976516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 974/2067] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:53:45.429946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:45.430556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:45.437072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:45.437521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:45.438271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:45.438703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:45.569554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:45.577682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fa34f22-f422-44ff-845a-b41088b396ab tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151776 Aug 03 09:53:45.578245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1094/2068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:45.999638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:46.000248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:46.006867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:46.007319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:46.008078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:46.008512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:46.139111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:46.147436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:46.148969 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:46.150122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c29dc97-ec98-474d-84d3-87680bb929ea tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154450 Aug 03 09:53:46.151788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 975/2069] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:46.599145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:46.599751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:46.606326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:46.606769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:46.607576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:46.608008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:46.738653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:46.740834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:46.747832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b4d50c6-4d8c-4004-aa64-173decf98cd3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152584 Aug 03 09:53:46.748432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1095/2070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:47.175135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:47.175740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:47.182957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:47.183396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:47.184157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:47.184584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:47.316932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:47.325563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:47.327101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:47.328321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-af86002a-7c28-4877-ab88-9be8c31798a4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157126 Aug 03 09:53:47.329128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 976/2071] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:47.768369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:47.769021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:47.776344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:47.776795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:47.777564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:47.777994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:47.905162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:47.912996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd5156ab-d7e5-44cc-b2b5-7e7428d2a419 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148470 Aug 03 09:53:47.913554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1096/2072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:48.351617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:48.352221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:48.358719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:48.359162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:48.359924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:48.360351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:48.494536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:48.503227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:48.504723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:48.505960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-648744a0-5a2d-40dd-944d-21d60ec67d1f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158331 Aug 03 09:53:48.506511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 977/2073] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:48.934501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:48.935107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:48.941610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:48.942060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:48.942808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:48.943247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:49.072594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:49.080424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4675ac6e-85e0-4b87-b8de-bd4ccb03017c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149806 Aug 03 09:53:49.081011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1097/2074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:48 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:49.529751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:49.530253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:49.536846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:49.537287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:49.538033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:49.538461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:49.541112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:53:49.672757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:49.681120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:49.683000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:49.684309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74330bb8-c27c-4dec-aa4c-aa4d701c1fac tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.159200 Aug 03 09:53:49.685147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 978/2075] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:50.102633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:50.103237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:50.109858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:50.110297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:50.111044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:50.111472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:50.246365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:50.254413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c242bac4-5a36-489c-8be9-72ecdace05e0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155590 Aug 03 09:53:50.254970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1098/2076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:50.708272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:50.708897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:50.715875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:50.716308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:50.717086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:50.717515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:50.843961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:50.852258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:50.853844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:50.855636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7133e8b-35ac-41b8-a1f4-5fe19aaa957c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151272 Aug 03 09:53:50.856190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 979/2077] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:53:51.275386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:51.276002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:51.283025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:51.283473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:51.284235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:51.284672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:51.415495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:51.423963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2c8d7bee-1a22-4aa7-a7fe-358c7e952db7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152513 Aug 03 09:53:51.424524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1099/2078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:51.878272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:51.878870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:51.885318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:51.885754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:51.887031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:51.887456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:52.013259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:52.021623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:52.023116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:52.024261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-283a1a54-518a-4fbb-b85a-25019c25d894 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149933 Aug 03 09:53:52.024831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 980/2079] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:52.445211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:52.445820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:52.452458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:52.453011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:52.453765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:52.454204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:52.585414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:52.593220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a21f8110-afec-4628-a0a7-146518a41fcf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152124 Aug 03 09:53:52.593815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1100/2080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:53.048547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:53.049292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:53.056709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:53.056709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:53.057343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:53.058399 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:53.188878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:53.197529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:53.199032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:53.200383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-36bd6878-d590-4bb0-9ad3-be32e08d0590 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155622 Aug 03 09:53:53.200966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 981/2081] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:53.614982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:53.615588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:53.622047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:53.622491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:53.623246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:53.623681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:53.750441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:53.758272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4f8b0d90-53d1-4ae4-bf65-cb482380ed7f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147198 Aug 03 09:53:53.758837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1101/2082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:54.222320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:54.222951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:54.229389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:54.229828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:54.230578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:54.231091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:54.358334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:54.366633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:54.368123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:54.369324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-13d192c0-d19d-460e-9644-3319d3711459 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150897 Aug 03 09:53:54.369869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 982/2083] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:54.779939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:54.780548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:54.787006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:54.787445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:54.788190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:54.788618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:54.920659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:54.928610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d4f9533d-464d-48d1-84a3-c86e978036b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153384 Aug 03 09:53:54.929197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1102/2084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:54 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:55.393360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:55.393970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:55.400517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:55.401004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:55.401768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:55.402200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:55.533084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:55.541433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:55.542934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:55.544087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b713e38d-7841-4ba2-8416-1f43ac7ce93c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154662 Aug 03 09:53:55.544648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 983/2085] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:55.949171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:55.950418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:55.956868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:55.957314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:55.958064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:55.958491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:56.086460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:56.094436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b003559e-d4c3-49ac-a53f-cb0edf003798 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149156 Aug 03 09:53:56.095003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1103/2086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:55 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:56.567216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:56.567814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:56.574446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:56.574888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:56.575640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:56.576070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:56.704313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:56.712657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:56.714204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:56.715921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-755d08a0-a33b-42a1-848a-383c14433355 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152148 Aug 03 09:53:56.716519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 984/2087] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:57.115226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:57.115867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:57.122873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:57.123320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:57.124072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:57.124504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:57.251804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:57.259763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b50dbad8-53e3-4b32-93d6-a8bc8ec34e58 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148431 Aug 03 09:53:57.260308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1104/2088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:57.739657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:57.740257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:57.747687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:57.748140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:57.748928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:57.749361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:57.878863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:57.887379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:57.888946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:57.890094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3ebe32a-8478-49c9-a3e2-618c043c6618 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154386 Aug 03 09:53:57.890645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 985/2089] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:58.282007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:58.282618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:58.289248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:58.289693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:58.290441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:58.290875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:58.651826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:58.659641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-74c1802b-2e90-4b65-a648-41aab22857f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.382069 Aug 03 09:53:58.660204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1105/2090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:53:58.913064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:58.913623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:58.920294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:58.920744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:58.921602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:58.922037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:59.047662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:59.056123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:59.057662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:59.059401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-80efdf3d-ace2-4b4a-8c03-32f58c57af62 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149810 Aug 03 09:53:59.060227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 986/2091] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:53:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:53:59.680794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:53:59.681406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:53:59.688546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:59.689026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:59.689776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:53:59.690206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:53:59.827215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:53:59.835074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ed3d67b-c394-4510-a829-e7360e5f16d7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158178 Aug 03 09:53:59.835637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1106/2092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:53:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:00.083524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:00.084129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:00.091338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:00.091772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:00.092518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:00.092978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:00.219999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:00.228312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:00.229907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:00.231063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-678c37e5-0f17-4a04-a06d-b4fbddf4895a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151444 Aug 03 09:54:00.231612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 987/2093] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:00.856446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:00.857089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:00.863465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:00.863908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:00.864687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:00.865141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:00.995310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:01.003772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7806d7ea-2f69-4868-8b50-8b7495713de0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151732 Aug 03 09:54:01.004330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1107/2094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:01.253890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:01.254490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:01.256850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:01.262233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.262677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.263439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.263867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.399356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:01.408167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:01.409691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:01.410840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b3f16354-5b79-4fc3-b2f8-5018cecfe448 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160901 Aug 03 09:54:01.411394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 988/2095] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:01.614362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:01.614858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:01.621004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.622212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.622983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.623420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.662396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:54:01.739339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-783b8e01-c454-44b6-b33e-c779fa4c113f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 204 len: 0 microversion: 2.1 time: 0.128701 Aug 03 09:54:01.740208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1108/2096] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:54:01 2022] DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:54:01.751226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:01.751925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:01.758314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.759077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.759847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:01.760317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:01.893527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:01.901440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f45a87ff-5a74-46b3-be76-0badf3f876f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1720 microversion: 2.1 time: 0.156569 Aug 03 09:54:01.902001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 989/2097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:02.025092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:02.025792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:02.028709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:02.033946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.034391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:02.035145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.035578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:02.166916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:02.175630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5a3f8332-aa90-4a49-97d2-65e5589afd81 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154767 Aug 03 09:54:02.176180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1109/2098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:02 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:02.435888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:02.436426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:02.442913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.443356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:02.444110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.444795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:02.579244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:02.587747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:02.589273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:02.590957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7cefdd37-a64d-461c-9747-20572116d0cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160075 Aug 03 09:54:02.591509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 990/2099] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:02.923645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:02.924254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:02.930376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.930828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:02.931589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:02.932024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.170098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:03.173219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:03.180351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-39f689ef-cc8e-4089-a64a-47e6b09357c7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1720 microversion: 2.1 time: 0.260561 Aug 03 09:54:03.180949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1110/2100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1720 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:03.198436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:03.199042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:03.205320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:03.205763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.206510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:03.206941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.342001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:03.350433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-550c8b5c-b7ca-4516-a0c5-f8055b22ef6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156085 Aug 03 09:54:03.351215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 991/2101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:03.509924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:54:03.510571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:54:03.615150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:03.615866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:03.624716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:03.625586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.638315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:03.639116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.783626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-923efb6c-3ce9-4218-9194-7fd4a71cd8f9 req-acd1fc59-b9da-497f-a335-4ada17bf697f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a1a022-8f7e-4e28-9a07-49184dfcfcfd", "name": "network-vif-deleted", "tag": "11fbb955-cb55-401d-b52c-df2706864e50"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:54:03.794475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-923efb6c-3ce9-4218-9194-7fd4a71cd8f9 req-acd1fc59-b9da-497f-a335-4ada17bf697f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:03.795262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-923efb6c-3ce9-4218-9194-7fd4a71cd8f9 req-acd1fc59-b9da-497f-a335-4ada17bf697f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:03.804968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:03.809686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-923efb6c-3ce9-4218-9194-7fd4a71cd8f9 req-acd1fc59-b9da-497f-a335-4ada17bf697f service nova] Creating event network-vif-deleted:11fbb955-cb55-401d-b52c-df2706864e50 for instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd on hv-cinder-84456 Aug 03 09:54:03.814959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:03.815124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-923efb6c-3ce9-4218-9194-7fd4a71cd8f9 req-acd1fc59-b9da-497f-a335-4ada17bf697f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205460 Aug 03 09:54:03.815547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1111/2102] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:54:03.819150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:03.820655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f88c0fe-739b-49cb-9144-87b773403bed tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.210173 Aug 03 09:54:03.821235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 992/2103] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:04.202752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:04.203446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:04.209992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.210431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.211175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.211604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.278838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:04.286963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-11446703-d780-4c2c-a7df-d09e4f6d709b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088558 Aug 03 09:54:04.287528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1112/2104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:04.371641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:04.372246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:04.378488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.378930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.379683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.380107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.518458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:04.526354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8cac94aa-ba9c-48d4-9dda-3ddd6ee40869 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158694 Aug 03 09:54:04.526916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 993/2105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:04 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:04.844005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:04.844609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:04.850639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.851083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.851822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:04.852245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:04.978303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:04.987677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:04.989202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:04.990381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a8683d6b-0a1d-43a5-aae8-3c6e94df923c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150803 Aug 03 09:54:04.990933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1113/2106] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:05.307413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:05.308058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:05.314665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:05.315118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:05.315882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:05.316318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:05.377911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:05.380053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:05.388014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d70f0bd4-2a14-4f3d-a705-6a4752daf4b3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084218 Aug 03 09:54:05.388581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 994/2107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:05.547730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:05.548250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:05.554780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:05.555230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:05.555976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:05.556407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:05.691853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:05.700684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8e95e671-f3c7-4cc2-b5a5-090e91e04dd6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156995 Aug 03 09:54:05.701305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1114/2108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:06.014162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:06.014759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:06.020684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.021273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.022024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.022454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.150480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:06.159559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:06.161133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:06.162297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-288d2e28-94b7-4bc1-8269-d269af5533d8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153070 Aug 03 09:54:06.162855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 995/2109] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:06.408690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:06.409335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:06.415513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.415990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.416770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.417233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.479653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:06.488104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-131068d8-b1c9-41ea-a134-334df86bf1f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083302 Aug 03 09:54:06.488658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1115/2110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:06.721726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:06.722252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:06.728699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.729166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.729918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:06.730342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:06.857154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:06.864975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-078616cf-4238-41c4-9dbb-055628a8cff9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147182 Aug 03 09:54:06.865532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 996/2111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:07.185731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:07.186324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:07.192686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.193157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:07.193902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.194333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:07.324344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:07.332681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:07.334224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:07.335417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ffca934-786f-46f6-93f9-f58b9d7efacf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153729 Aug 03 09:54:07.335974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1116/2112] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:07.509275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:07.509908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:07.516396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.516860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:07.517614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.518042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:07.577819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:07.585621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7103ea1-26bc-49e0-8f01-840fd31350e6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080173 Aug 03 09:54:07.586171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 997/2113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:07.886226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:07.887433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:07.893433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.893881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:07.894634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:07.895066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:08.027932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:08.035860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f33f470b-0bc7-4032-91d1-1dfb76880619 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153463 Aug 03 09:54:08.036426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1117/2114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:07 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:08.358477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:08.359091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:08.365632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:08.366083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:08.366844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:08.367276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:08.498617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:08.506872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:08.508368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:08.509542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-686deccc-ff6c-4ac6-9f0a-03b4f991efff tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155414 Aug 03 09:54:08.510086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 998/2115] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:08.607061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:08.607673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:08.614377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:08.614829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:08.615586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:08.616022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:08.676747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:08.685478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4a1eddd0-232d-4123-853d-febb5445b675 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082492 Aug 03 09:54:08.686039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1118/2116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:09.057797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:09.058412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:09.064714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.065190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.065952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.066385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.194815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:09.203287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7f20e11-af90-48cb-b8a4-d2e415afb40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149528 Aug 03 09:54:09.203842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 999/2117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:09 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:09.533080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:09.533806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:09.539748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.540189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.540954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.541380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.683223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:09.693525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:09.696021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:09.697462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-28e3f903-deda-4e7e-8489-1cf14d482e8c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.168173 Aug 03 09:54:09.698307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1119/2118] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:09.706382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:09.707075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:09.713591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.714032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.714788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:09.715217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:09.776304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:09.784477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b38775a8-4a35-40b6-9499-5755c6356d58 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081827 Aug 03 09:54:09.785005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1000/2119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:10.224836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:10.225442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:10.232204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.232652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.233442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.233879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.366568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:10.374637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc5781f0-6d5a-406c-b856-86bbc98055fa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153677 Aug 03 09:54:10.375198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1120/2120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:10.721409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:10.722018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:10.728616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.729089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.729849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.730282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.805774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:10.806531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:10.814167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.814624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.815378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:10.816038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:10.862174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:10.870675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:10.873425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:10.874626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-46c90303-1a3e-4d8d-9601-d7bf22ad2479 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157160 Aug 03 09:54:10.875187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1001/2121] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:10.879767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:10.888543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e407185-76c8-4724-8a90-4857cbd3e465 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086697 Aug 03 09:54:10.889196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1121/2122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:11.395839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:11.396444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:11.403111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.403572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.404333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.404771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.530979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:11.538891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-994d351f-5305-4d02-ab40-a52c0626d23e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146968 Aug 03 09:54:11.539448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1002/2123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:11 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:11.898525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:11.899131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:11.906697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.907146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.907907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.908342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.909481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:11.910088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:11.916501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.916915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.917679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:11.918251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:11.979846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:11.987889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-84b3a639-eb55-4963-8e8d-7a202606c3f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082183 Aug 03 09:54:11.988459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1003/2124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:12.038102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:12.046435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:12.047953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:12.049127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2b8a98ad-ae52-478b-8089-9ef575fa2b5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154441 Aug 03 09:54:12.049688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1122/2125] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:12.561353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:12.561907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:12.568198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:12.569268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:12.570318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:12.570755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:12.705927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:12.713765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc6c28b5-fff0-458e-82af-bc592afba7f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.157019 Aug 03 09:54:12.714324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1004/2126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:13.007596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:13.008196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:13.015315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.015753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.016498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.016946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.071755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:13.072354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:13.079607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.080121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.080923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.081351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.083175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:13.091159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c738b9a4-9dc2-404f-8a38-c9c4ebf11c7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087418 Aug 03 09:54:13.091721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1123/2127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:13.210050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:13.218406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:13.219899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:13.222046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-825dc793-9187-446e-8e5f-ab92b3bfd23a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153462 Aug 03 09:54:13.222893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1005/2128] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:13.735418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:13.736035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:13.742076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.742523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.743281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:13.743715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:13.874613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:13.882408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-276e51bc-a32a-4e1f-a887-caa8a59d9bf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150894 Aug 03 09:54:13.883019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1124/2129] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:14.112835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:14.113462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:14.120052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.120498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:14.122024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.122501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:14.186024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:14.193887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6cf59f9b-bded-48da-8d84-ec66045c20b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084915 Aug 03 09:54:14.194456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1006/2130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:14.245140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:14.245746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:14.252271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.252716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:14.253510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.253943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:14.379976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:14.388708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:14.390264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:14.391421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d65cccbd-40c1-40f0-99ab-f0bf6598787f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150376 Aug 03 09:54:14.391987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1125/2131] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:14.903284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:14.903929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:14.910058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.910499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:14.911289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:14.911716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:15.215584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:15.216211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:15.222237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:15.222688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:15.223439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:15.223874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:15.288341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:15.290907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:15.298843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f3d45c3-ba8f-46cf-92c5-f5747bd14af3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087799 Aug 03 09:54:15.299411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1126/2132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:15.299817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-68bc2bd2-c70c-4b75-9586-f353c2dd90bd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.400281 Aug 03 09:54:15.300381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1007/2133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:14 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:15.414209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:15.414809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:15.420936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:15.421379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:15.422123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:15.422549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:15.549281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:15.557515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:15.559001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:15.560768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0a691eb-46ef-4c42-bd8f-4766af276dc0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150400 Aug 03 09:54:15.561342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1127/2134] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:16.320619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:16.321241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:16.321446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:16.322052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:16.328724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.328985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.329196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.329385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.329963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.330114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.330398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.330528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.333179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:16.395177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:16.403134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bb3b546e-d083-42d2-bced-54dd605635d5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086746 Aug 03 09:54:16.404557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1008/2135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:16.462350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:16.471232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-111678d6-738c-420d-89b0-30f694e562a9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153881 Aug 03 09:54:16.471798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1128/2136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:16 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:16.584371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:16.584921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:16.591587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.592243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.593097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:16.593525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:16.724381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:16.733007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:16.734497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:16.735640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8a6eba2-e994-40e4-a9d0-c70ac1430339 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155253 Aug 03 09:54:16.736187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1009/2137] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:17.425184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:17.425793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:17.432223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.432669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.433475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.433908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.492397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:17.493020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:17.499646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:17.500021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.500463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.501251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.501683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.507544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83453a2e-5622-41ca-ad55-f9f82e65879c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086213 Aug 03 09:54:17.508113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1129/2138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:17.629090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:17.636991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb1b306d-1e2b-42ae-838f-db67b5093a4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148497 Aug 03 09:54:17.637788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1010/2139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:17.758855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:17.759415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:17.765974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.766414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.767160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:17.767586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:17.895762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:17.904864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:17.906378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:17.907552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b799ec6d-8884-45ad-a82e-9d80bace0c5f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152630 Aug 03 09:54:17.908103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1130/2140] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:18.527968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:18.529177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:18.535575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.536011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:18.536758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.537212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:18.552582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:18.598768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:18.607395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-de404f40-2bff-483a-9975-e9f4ae98836a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082436 Aug 03 09:54:18.608080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1011/2141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:18.659484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:18.660096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:18.666734 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.667181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:18.667936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.668366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:18.794850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:18.802611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17aa855c-c949-4c59-8604-4170f3d29e04 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147013 Aug 03 09:54:18.803165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1131/2142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:18 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:18.930332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:18.930937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:18.937470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.937920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:18.938680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:18.939114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:19.071935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:19.081576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:19.083083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:19.084241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9a6e3e1-7bfd-4e22-9f47-30a40d5fa180 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157876 Aug 03 09:54:19.084795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1012/2143] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:19.628566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:19.629248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:19.635281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:19.635733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:19.636499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:19.636970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:19.701986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:19.709915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-406fdaa7-c704-46fc-a3a5-f03d48457829 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085249 Aug 03 09:54:19.710474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1132/2144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:19.823602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:19.824212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:19.831349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:19.831790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:19.832549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:19.833020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:19.960556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:19.969083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-284fc8be-e270-493d-86a5-508a8e897f33 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149606 Aug 03 09:54:19.969648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1013/2145] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:20.108693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:20.109388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:20.115358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.115799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:20.116545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.117007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:20.245149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:20.253649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:20.255158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:20.256313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45d952a9-1295-427f-96fd-5236e893ce0f tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152375 Aug 03 09:54:20.256905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1133/2146] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:20.731237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:20.731960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:20.738028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.738472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:20.739217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.739643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:20.801955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:20.809840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eff639cd-8dcb-4f9c-a7d1-0e0233ff0e11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082352 Aug 03 09:54:20.810599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1014/2147] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:20.990386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:20.990913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:20.997321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.997758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:20.998503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:20.998926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:21.127813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:21.135751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62a10744-5de7-4e0b-bf35-0ff2dbf68c32 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149308 Aug 03 09:54:21.136318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1134/2148] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:21.279998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:21.280525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:21.288045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:21.288490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:21.289286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:21.289726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:21.426504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:21.435552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:21.437077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:21.438227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe5accdd-fb13-4c66-b401-8a5fbb0628b9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.162503 Aug 03 09:54:21.438782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1015/2149] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:21.831011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:21.831617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:21.837692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:21.838131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:21.838876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:21.839302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:21.902263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:21.910775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2b0f372-294a-42d1-9aee-e47012f897b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083639 Aug 03 09:54:21.911359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1135/2150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:22.156870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:22.157770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:22.163525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.163974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:22.164731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.165191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:22.291102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:22.298991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a476afab-d1d8-4a4b-b0cb-7a4062e7aa39 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146262 Aug 03 09:54:22.299549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1016/2151] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:22 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:22.462209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:22.462744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:22.469859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.470301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:22.471164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.471594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:22.605418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:22.613924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:22.615421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:22.616555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a082d95-1fa6-4fb1-974f-8299b3c62946 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158309 Aug 03 09:54:22.617145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1136/2152] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:22.931407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:22.932021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:22.938754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.939202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:22.939961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:22.940396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:23.002777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:23.010594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df5d716c-f209-43d1-97b6-d49a05a300cb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083092 Aug 03 09:54:23.011149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1017/2153] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:23.319573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:23.320432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:23.326425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:23.326869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:23.327611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:23.328035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:23.453867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:23.461726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-78e943b4-c889-4ce6-a873-21354f206e99 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146031 Aug 03 09:54:23.462277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1137/2154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:23 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:23.639565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:23.640168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:23.646161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:23.646603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:23.647357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:23.647789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:23.777670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:23.787332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:23.788834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:23.789988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e9ebed56-60c2-4d83-b82b-8346d5299bf0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154462 Aug 03 09:54:23.790544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1018/2155] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:24.031931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:24.032450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:24.038902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.039352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.040114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.040546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.106161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:24.114839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b31655a-f60e-49ae-95a7-8f0d6cd006a8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087135 Aug 03 09:54:24.115397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1138/2156] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:24.484264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:24.484899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:24.490923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.491360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.492109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.492536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.621700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:24.629627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ceaac0c4-2982-44df-9e42-9a1ebe0f0fa9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149981 Aug 03 09:54:24.630187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1019/2157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:24.813562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:24.814102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:24.820413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.820890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.821647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:24.822082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:24.948646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:24.957692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:24.959199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:24.960347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9fcbd562-e547-43f6-9438-c17a3526ccd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150955 Aug 03 09:54:24.960928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1139/2158] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:25.136742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:25.137377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:25.143826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.144266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:25.145053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.145486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:25.210264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:25.218644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e2db5422-72f6-4a41-b9bd-e7de3a8ed62e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085730 Aug 03 09:54:25.219203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1020/2159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:25.651378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:25.651995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:25.659488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.659968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:25.660746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.661207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:25.789864 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:25.798493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5b5d8f42-0d05-4e1c-806e-793be42ee03e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151066 Aug 03 09:54:25.799064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1140/2160] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:25 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:25.984849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:25.985400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:25.991467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.991917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:25.992680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:25.993142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:26.121643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:26.129839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:26.131326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:26.132469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-947b92aa-16b5-4d24-8645-6943c67675a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.152523 Aug 03 09:54:26.133066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1021/2161] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:26.238757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:26.239306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:26.245392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:26.245847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:26.246606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:26.247043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:26.313611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:26.322030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b5ca3ab2-c54c-432a-9f6e-1c07264575b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087137 Aug 03 09:54:26.322601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1141/2162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:26.818987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:26.819575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:26.826974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:26.827404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:26.828150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:26.828575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:26.954004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:26.961791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8989940d-a982-4a4e-a5a3-8cd115bc319d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146657 Aug 03 09:54:26.962356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1022/2163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:27.157109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:27.157721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:27.164315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.164762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:27.165546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.165974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:27.295125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:27.304221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:27.305782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:27.306997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1320e35b-535d-46a7-a479-cdd95c99c9ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154649 Aug 03 09:54:27.307535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1142/2164] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:27.343342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:27.343970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:27.349987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.350429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:27.351186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.351618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:27.416410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:27.424324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b0084d78-a741-4853-82ad-f4005774fffb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084871 Aug 03 09:54:27.424898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1023/2165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:27.983967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:27.984577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:27.990601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.991042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:27.991782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:27.992208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:28.123262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:28.131249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-162bc6eb-6a7c-4f3f-98c9-1c24d5896c77 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151795 Aug 03 09:54:28.131812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1143/2166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:28.331548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:28.332079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:28.338511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:28.338953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:28.339703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:28.340126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:28.444246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:28.444882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:28.451781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:28.452239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:28.453038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:28.453475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:28.472765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:28.481082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:28.482586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:28.483748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c1ef70df-2934-42d0-a1b3-0f940c4384f9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156231 Aug 03 09:54:28.484501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1024/2167] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:28.515737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:28.517937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:28.525089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-285508f5-87e8-496a-aff2-49edcb4d678e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084546 Aug 03 09:54:28.525657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1144/2168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:29.152273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:29.152909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:29.159647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.160102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.160890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.161327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.287165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:29.294970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96a67f89-f0ec-471d-a813-34e3f9de7bef tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146574 Aug 03 09:54:29.295540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1025/2169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:29 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:29.506843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:29.507445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:29.514688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.515208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.515958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.516393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.546114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:29.546712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:29.553123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.553562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.554321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:29.554748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:29.620089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:29.628677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-228d14c4-ed95-4e90-a149-3c6ce9f357d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086343 Aug 03 09:54:29.629267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1026/2170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:29.645893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:29.654301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:29.655827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:29.657003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-836dd890-39f3-4d4a-bfaf-e8ce79416162 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154015 Aug 03 09:54:29.657557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1145/2171] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:30.316137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:30.316671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:30.322972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.323418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.324184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.324620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.452321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:30.460220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f82c9da3-6c97-4c01-8e79-a390d802c1ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148045 Aug 03 09:54:30.460792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1027/2172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:30 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:30.650049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:30.650656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:30.657210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.657653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.658401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.658832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.679744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:30.680350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:30.687642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.688075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.688854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:30.689282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:30.693372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:30.720755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:30.728796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-250fcb77-02bf-44a7-bee6-4035d0981c75 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082616 Aug 03 09:54:30.729580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1146/2173] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:30.818625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:30.827511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:30.829040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:30.830185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-64526ce2-edd3-4061-8ad9-2ac384dfef14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154597 Aug 03 09:54:30.830728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1028/2174] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:31.480773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:31.481410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:31.487447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.487897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.488655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.489121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.620538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:31.628802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b927595-ce2b-4060-8672-2dbc110a9ba4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151870 Aug 03 09:54:31.629334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1147/2175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:31 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:31.750253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:31.750867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:31.753199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=82 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:31.758350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.758793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.759552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.759981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.824013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:31.832787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-61bd9f47-1b92-430a-b61d-8d43457153ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086935 Aug 03 09:54:31.833369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1029/2176] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:31.852820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:31.853433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:31.859861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.860301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.861080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:31.861504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:31.991258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:32.000070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:32.001594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:32.002735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-969ad9a9-4d7c-4444-8a5f-662601effbe3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153797 Aug 03 09:54:32.003283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1148/2177] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:32.650199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:32.650808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:32.657319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:32.657763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:32.658517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:32.658952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:32.786976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:32.794858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ebe7c782-19c1-48d9-8e79-882f0448dce3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148609 Aug 03 09:54:32.796252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1030/2178] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:32.853662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:32.854291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:32.856605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=80 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:32.861826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:32.862275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:32.863036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:32.863473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:32.929041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:32.936858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-136d0767-0e06-4d11-bb3b-291e29c47f2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087168 Aug 03 09:54:32.937414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1149/2179] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:33.026182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:33.026785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:33.033372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.033813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:33.034554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.034980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:33.162907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:33.171567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:33.173110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:33.174270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-048208d9-f4aa-42d0-8aed-103618da3c29 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151964 Aug 03 09:54:33.174834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1031/2180] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:33.816271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:33.816900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:33.823188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.823631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:33.824386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.824795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:33.950992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:33.957533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:33.958147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:33.959024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a4c0ee8b-7d77-4765-bec4-189d8ce969f3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146528 Aug 03 09:54:33.959607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1150/2181] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:33.964601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.965070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:33.965839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:33.966275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:34.031157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:34.039024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-23184f82-b244-45cb-9123-6b26cb5676b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085299 Aug 03 09:54:34.039584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1032/2182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:34.197783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:34.198397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:34.204403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:34.204882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:34.205644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:34.206083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:34.335057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:34.343993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:34.345531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:34.346689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-866f89f3-a141-4977-8901-90918573c1e4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153124 Aug 03 09:54:34.347246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1151/2183] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:34 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:34.981099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:34.981697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:34.989281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:34.989722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:34.990478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:34.990908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:35.059615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:35.060233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:35.067378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:35.067828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:35.068589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:35.069056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:35.121469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:35.129543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ac0bd67c-e417-49b1-bb3c-f8ae6ef49224 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152291 Aug 03 09:54:35.130109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1033/2184] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:34 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:35.135912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:35.144491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7bcee20b-8266-4296-bc07-c3988a9a4732 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088772 Aug 03 09:54:35.145082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1152/2185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:35.369650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:35.370247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:35.376764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:35.377239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:35.377983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:35.378410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:35.506099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:35.514383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:35.515872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:35.517041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1012ec97-3c85-4883-967c-ecfaa45a0287 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151351 Aug 03 09:54:35.517593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1034/2186] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:35 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:36.151242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:36.151854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:36.158914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.159344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.160099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.160539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.165567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:36.166168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:36.173644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.174111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.174878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.175310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.242391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:36.250299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee16a930-2469-4b5f-a49c-e4a389fd659e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088582 Aug 03 09:54:36.250876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1035/2187] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:36.293771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:36.302547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4b2bab18-adbb-4071-8425-c326d01f66b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155196 Aug 03 09:54:36.303114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1153/2188] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:36.540031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:36.540635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:36.548524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.549008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.549798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:36.550228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:36.699526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:36.708429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:36.710022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:36.711183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e914cd21-0f46-4dd2-8289-ae5e9f352cf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.175079 Aug 03 09:54:36.711743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1036/2189] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:36 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:37.271405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:37.272034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:37.278510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.278958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.280262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.280772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.323798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:37.324350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:37.331613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.332056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.332828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.333260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.343316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:37.351438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-163349f3-74c4-40c1-b4e3-890f61f219e9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083954 Aug 03 09:54:37.352097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1154/2190] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:37.460199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:37.468980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5dfab380-d025-4d71-97d7-d52996660677 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149384 Aug 03 09:54:37.469540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1037/2191] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:37.735883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:37.736488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:37.742504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.742952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.743697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:37.744131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:37.873365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:37.881749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:37.883261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:37.884409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c6d0372a-d87e-4f0c-ad21-1e60011e7fb3 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153261 Aug 03 09:54:37.884992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1155/2192] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:37 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:38.371592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:38.372226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:38.378796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.379236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:38.379991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.380417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:38.447473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:38.456110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3374b130-e7ec-4473-9bb0-733c01a006f4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088427 Aug 03 09:54:38.456674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1038/2193] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:38.489666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:38.490293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:38.496782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.497259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:38.498780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.499380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:38.633199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:38.641845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eaa148d5-b42a-41cf-9e48-906642da56a4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155949 Aug 03 09:54:38.642405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1156/2194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:38.907959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:38.908569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:38.914631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.915078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:38.915838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:38.916271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:39.042575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:39.051101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:39.052620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:39.053821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8f990e5-ca4c-45b2-bc2d-eba513589a33 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150457 Aug 03 09:54:39.054379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1039/2195] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:38 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:39.476961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:39.477601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:39.483710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:39.484146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:39.484912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:39.485344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:39.547201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:39.555086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0cf93c0-8c4b-4ba5-b91c-d87204215a67 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081942 Aug 03 09:54:39.555592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1157/2196] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:39.663052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:39.663654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:39.670724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:39.671158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:39.671901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:39.672324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:39.799965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:39.807920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c4febc35-15ff-4d98-a0ea-ef87db6d0d9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148653 Aug 03 09:54:39.808407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1040/2197] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:40.076476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:40.077056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:40.083188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.083638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.084394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.084836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.216324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:40.225481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:40.227008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:40.228163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f676e117-ac3a-43ad-838d-acc21b74645d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155983 Aug 03 09:54:40.228719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1158/2198] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:40 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:40.577007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:40.577617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:40.583737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.584181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.584958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.585398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.650991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:40.659523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d32c1b98-ab8b-409c-a44a-753b1e6c5ba3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087096 Aug 03 09:54:40.660082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1041/2199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:40.830733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:40.831271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:40.837688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.838132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.838886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:40.839318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:40.968109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:40.976103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0ae5500-dbfc-4844-a1c7-1c78c40949f4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150896 Aug 03 09:54:40.976664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1159/2200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:41.255816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:41.256419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:41.262963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:41.263404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:41.264512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:41.264971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:41.393809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:41.402116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:41.403609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:41.405306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-796c1263-daca-4bb3-80d6-0111e3502dd1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153192 Aug 03 09:54:41.405864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1042/2201] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:41 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:41.680342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:41.680975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:41.687525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:41.687964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:41.688707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:41.689155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:41.749885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:41.757891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-356ea14b-5dd4-4b8e-8e4d-fb3a4de0c6ec tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081403 Aug 03 09:54:41.758445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1160/2202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:41.996769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:41.997530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:42.004311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.004761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.005561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.005987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.156585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:42.165931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c227b51b-ff62-4bfe-9813-5864168e56f1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.173089 Aug 03 09:54:42.166944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1043/2203] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:42.429141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:42.429881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:42.439012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.439826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.441236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.441738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.459174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:42.587563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:42.596313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:42.597849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:42.599013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b6465aa-b2b2-4d92-9127-c32c24dfa24d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.173910 Aug 03 09:54:42.599566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1161/2204] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:42 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:42.778623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:42.779521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:42.785749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.786192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.786944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:42.787375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:42.851217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:42.853411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:42.861118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6186f097-6de9-404d-8aad-434be4e4852a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086441 Aug 03 09:54:42.861674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1044/2205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:43.189856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:43.190783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:43.197199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.197642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.198395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.198830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.332210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:43.340209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-419ba66b-ab50-4e5d-8cf2-4f39c062db9d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155737 Aug 03 09:54:43.340793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1162/2206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:43.624341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:43.624983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:43.631122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.631594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.632348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.632776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.762554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:43.771184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:43.772680 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:43.773854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d28bd64b-d9e8-494b-ad45-ee6af09b09f7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154186 Aug 03 09:54:43.774402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1045/2207] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:43 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:43.882878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:43.883483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:43.890323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.890772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.891524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:43.891960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:43.953522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:43.961213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f76be5f5-6ea0-4b19-ba18-07fc03879bb0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082231 Aug 03 09:54:43.961772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1163/2208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:44.362822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:44.363488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:44.369998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.370441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:44.371193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.371623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:44.501090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:44.509000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-60e99d53-fc4b-4ba2-b9af-cfd229267564 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149969 Aug 03 09:54:44.509577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1046/2209] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:44.798287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:44.798810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:44.804901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.805350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:44.806099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.806532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:44.940075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:44.948706 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:44.950234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:44.951462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f9a46dfe-7832-4416-a279-710117428d14 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157961 Aug 03 09:54:44.952022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1164/2210] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:44 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:44.983490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:44.984109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:44.990145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.990594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:44.991348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:44.991783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:45.056132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:45.064750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ee70ce0-ba24-4904-90af-a09a581cccf3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085668 Aug 03 09:54:45.065348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1047/2211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:45.530738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:45.531347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:45.537379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:45.537821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:45.538574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:45.539010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:45.665730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:45.674392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e72f97bf-1c8f-48c4-a4dc-73ebe587c56c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147969 Aug 03 09:54:45.674954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1165/2212] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:45.973920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:45.974455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:45.980939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:45.981380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:45.982121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:45.983261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:46.085898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:46.086633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:46.093637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:46.094167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:46.094943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:46.095381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:46.112200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:46.120535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:46.122044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:46.123257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92f0d9e0-71e9-4e8d-ae9d-29da112ff39e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153334 Aug 03 09:54:46.123815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1048/2213] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:45 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:46.160756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:46.168614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87587fa4-55e5-47cf-afb5-e403ba71b660 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086548 Aug 03 09:54:46.169198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1166/2214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:46.695828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:46.696441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:46.703217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:46.703661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:46.704419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:46.704881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:46.830139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:46.838056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f81168ba-c5d0-41d3-a95d-76a5ab44dd16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146359 Aug 03 09:54:46.838614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1049/2215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:47.146129 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:47.146736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:47.153234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.153662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.154414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.154846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.193146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:47.193874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:47.200574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.201046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.201809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.202236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.267864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:47.275793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7baad1cf-682f-46b2-89b1-fec14d37dd36 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086776 Aug 03 09:54:47.276356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1050/2216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:47 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:47.288024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:47.297148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:47.298650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:47.299798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d06b8d8-6ee4-460c-b607-ed3b87c19f7c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157572 Aug 03 09:54:47.300346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1167/2217] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:47 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:47.859772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:47.860373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:47.866625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.867070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.867819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:47.868248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:47.994887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:48.002818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe1a2ddd-f97d-4e29-8994-706527638726 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147472 Aug 03 09:54:48.003379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1051/2218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:48.297051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:48.297586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:48.304043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:48.304498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:48.305280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:48.305720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:48.323744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:48.324339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:48.331367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:48.331805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:48.332557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:48.333014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:48.369451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:48.378202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00ae6c3b-36d1-424d-b7c5-dca10b3117ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085037 Aug 03 09:54:48.378988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1168/2219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:48.464793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:48.473909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:48.475425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:48.476578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c21dab46-c9db-4b55-8fdd-3641bbb4b34e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156993 Aug 03 09:54:48.477208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1052/2220] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:48 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:54:49.024145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:49.024749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:49.031402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.031840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.032585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.033043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.163616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:49.172770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1bbc75fb-0bf3-4997-bbf5-d9cb50f067fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152465 Aug 03 09:54:49.173366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1169/2221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:49 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:49.399562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:49.400283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:49.407520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.407964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.408726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.409197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.471443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:49.479422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96feeed3-ec8c-4d6d-b175-10a1b3ebb6dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083692 Aug 03 09:54:49.479995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1053/2222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:49.499495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:49.500114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:49.506637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.507088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.508330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:49.508330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:49.729582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:49.738640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:49.740117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:49.741431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d5d54981-f21a-48f6-9871-fdf6df3604de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.245751 Aug 03 09:54:49.741964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1170/2223] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:49 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:50.193496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:50.194126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:50.200445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.200925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.201683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.202732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.329990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:50.337896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8503c9ad-596a-4928-941a-1308aa70a01d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148315 Aug 03 09:54:50.338461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1054/2224] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:50.500760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:50.501390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:50.507855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.508300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.509081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.509515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.575112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:50.583585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1b79caf8-4881-4cea-a081-7429f72a2775 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087137 Aug 03 09:54:50.584144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1171/2225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:50.764835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:50.765454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:50.771594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.772035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.772780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:50.773231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:50.904593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:50.913602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:50.915101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:50.916252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b087781b-2070-42ed-9e7e-5a805918da34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155611 Aug 03 09:54:50.916805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1055/2226] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:50 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:51.359700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:51.360302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:51.366400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.366844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:51.367590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.368019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:51.496628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:51.504573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4958f39e-9070-48f6-b637-ab3d1b730dc3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149599 Aug 03 09:54:51.505177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1172/2227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:51.604721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:51.605512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:51.611999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.612439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:51.613222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.613651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:51.675159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:51.682947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d925f38-117d-4a4e-bde4-eae4286b2835 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082391 Aug 03 09:54:51.683493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1056/2228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:51.939883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:51.940411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:51.947158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.947608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:51.948348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:51.948776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:52.078397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:52.086626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:52.088115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:52.089295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67c33d02-b577-4c2e-a237-4e94f39fcc68 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154026 Aug 03 09:54:52.089836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1173/2229] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:51 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:52.524178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:52.524765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:52.531318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:52.531770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:52.532492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:52.532943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:52.659534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:52.667572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7c23a439-38d2-460d-afdc-dd49d5f734b6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147237 Aug 03 09:54:52.668132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1057/2230] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:52.704048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:52.704657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:52.710688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:52.711128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:52.711873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:52.712303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:52.776466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:52.785167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dec40dd0-89bd-4b90-97a2-a8b660738d6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084979 Aug 03 09:54:52.785723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1174/2231] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:53.112453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:53.113114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:53.119611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.120059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.120822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.121270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.251797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:53.260330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:53.261878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:53.263039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca53e3d8-7e69-412f-874c-7bdb92bee25a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154584 Aug 03 09:54:53.263766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1058/2232] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:53 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:53.689927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:53.690553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:53.697470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.697907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.698648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.699073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.806940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:53.807591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:53.813646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.814100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.814866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:53.815300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:53.833367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:53.841422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-053e7b56-d3a0-4769-bbd9-153e42e4ad57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155335 Aug 03 09:54:53.841997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1175/2233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:53.877777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:53.885552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ec5a5f0a-e80a-47d1-8cb1-b420ac89aa3d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082497 Aug 03 09:54:53.886107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1059/2234] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:54.287274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:54.287876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:54.293928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.294368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.295113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.296174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.419666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:54.428768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:54.430300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:54.431450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c9e71c3-f34d-4dfb-a2ca-b810418d32b0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148123 Aug 03 09:54:54.432022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1176/2235] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:54 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:54.863283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:54.863911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:54.870387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.870824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.871570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.871995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.907201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:54.907897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:54.914782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.915312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.916147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:54.916581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:54.981875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:54.989842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b111b65-b50c-4e48-83b4-4d5d9626a0c1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087126 Aug 03 09:54:54.990413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1177/2236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:55.002658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:55.010502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ab15dcf-77cf-40fa-ad2b-07e8dd8eb5cb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151103 Aug 03 09:54:55.011054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1060/2237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:54 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:55.454484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:55.455122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:55.461159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:55.461603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:55.462354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:55.462785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:55.466641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:55.589924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:55.598314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:55.599797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:55.600991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-09feafae-003f-4649-be91-5f736891c546 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150553 Aug 03 09:54:55.601539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1178/2238] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:55 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:56.011596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:56.012196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:56.018916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.019356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.020112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.020542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.032053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:56.032686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:56.036402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:54:56.039217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.039668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.040416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.040870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.089947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:56.098654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-831895c0-1132-45d6-a13d-aae8aca18201 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.090849 Aug 03 09:54:56.099226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1061/2239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:56.172151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:56.180127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-372d5a21-e970-4ae1-81a1-421a96df950c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152524 Aug 03 09:54:56.180696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1179/2240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:54:56.624483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:56.625033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:56.631187 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.631634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.632419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:56.632873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:56.761900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:56.770813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:56.772313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:56.773499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8721a5f5-de25-44d7-a011-f42ae11330bc tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153629 Aug 03 09:54:56.774050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1062/2241] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:56 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:57.119747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:57.120368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:57.127565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.128019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.128793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.129309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.191755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:57.200000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8984afc2-0326-475e-a508-b7e1ea4c6cdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084120 Aug 03 09:54:57.200563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1180/2242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:57.201103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:57.201709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:57.207922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.208370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.209138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.209577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.338472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:57.347060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2feb8bd1-b42a-42b5-98ae-2edf42bae0a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149647 Aug 03 09:54:57.347630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1063/2243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:57.797543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:57.798145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:57.804382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.804877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.805624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:57.806060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:57.932461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:57.941553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:57.943078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:57.944220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33d129e4-532c-4ecd-8e69-c51d60efc65e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151146 Aug 03 09:54:57.944771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1181/2244] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:57 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:58.221097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:58.221708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:58.228184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.228627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:58.229401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.229828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:58.293455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:58.302185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3b2a14e-63cd-4144-a211-2e2d99673afc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085463 Aug 03 09:54:58.302739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1064/2245] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:58.367320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:58.367959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:58.374606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.375050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:58.375795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.376219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:58.501833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:58.509621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd9c2b29-6917-4d50-975a-241850b49ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146099 Aug 03 09:54:58.510177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1182/2246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:58.967374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:58.967965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:58.973953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.974497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:58.975248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:58.975671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:59.102840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:59.111753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:59.113322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:59.114471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4a4da14a-0f01-43d6-a63a-1a86b2ab77a5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151074 Aug 03 09:54:59.115028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1065/2247] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:54:58 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:54:59.323749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:59.324358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:59.330637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:59.331084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:59.331833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:59.332265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:59.396154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:59.404203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c34d33ff-a909-4910-9e16-f073b259068f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084609 Aug 03 09:54:59.405094 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1183/2248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:54:59.530980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:54:59.531591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:54:59.538135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:59.538587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:59.539342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:54:59.539782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:54:59.667984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:54:59.676419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-08325ffa-425f-4385-bbcb-36da9abf6a57 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149766 Aug 03 09:54:59.677014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1066/2249] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:54:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:00.137479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:00.138088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:00.145351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.145802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.146557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.146990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.276784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:00.285284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:00.286790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:00.287932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3e45fd49-a556-4fe6-b970-f549a6261e45 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154380 Aug 03 09:55:00.288488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1184/2250] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:00 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:00.425038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:00.425642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:00.431572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.432010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.432753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.433197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.496621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:00.505202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a0b4062e-8b39-4d09-85e8-cb9d48c1ff20 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084029 Aug 03 09:55:00.505768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1067/2251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:00.697097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:00.697700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:00.704154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.704588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.705357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:00.705784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:00.834641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:00.842674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-faa080b3-7926-4cad-96d3-69400e7e424a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149539 Aug 03 09:55:00.843237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1185/2252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:01.310724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:01.312092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:01.318721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.319160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:01.319912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.320338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:01.449947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:01.458581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:01.460068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:01.461233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e45590d-9743-423f-a4b1-ad7a2c0eb989 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154466 Aug 03 09:55:01.461981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1068/2253] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:01 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:01.526835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:01.527450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:01.534254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.534711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:01.535469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.535905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:01.598723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:01.607830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c3c63992-2156-4ecd-a3fb-b8b24a381fb5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084849 Aug 03 09:55:01.608394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1186/2254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:01.863998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:01.864605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:01.866623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=80 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:01.871874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.872314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:01.873085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:01.873564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:02.004150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:02.011942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7b76ae5c-a951-46f4-a31c-57d53562edb5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151929 Aug 03 09:55:02.012504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1069/2255] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:01 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:02.484081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:02.484694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:02.492403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:02.492868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:02.493628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:02.494067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:02.629446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:02.630139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:02.632243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:02.637156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:02.637601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:02.638482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:02.638793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:02.642742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:02.643914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:02.645298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2d8acb18-07a6-481b-86f2-d69017fb1fc4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.165576 Aug 03 09:55:02.645894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1187/2256] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:02 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:02.709906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:02.718468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-24753164-6b13-4f44-ae65-bd0ba52909bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.092954 Aug 03 09:55:02.719025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1070/2257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:03.034291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:03.034949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:03.036994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:03.042981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.043442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.044245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.044682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.177678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:03.187974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cc26f4c8-ea34-4c21-8e82-1f451697a00c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158460 Aug 03 09:55:03.188536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1188/2258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:03.668944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:03.669546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:03.676776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.677254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.678010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.678444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.739571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:03.740185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:03.746620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.747073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.747840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:03.748276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:03.807888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:03.814308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:03.817363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:03.818893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:03.820041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-43f67804-d6f0-4c0d-97e8-04ce65677c63 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155145 Aug 03 09:55:03.820595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1071/2259] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:03 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:03.822530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cea44c1f-1132-4302-87ac-0be79a7c14a6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086836 Aug 03 09:55:03.823093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1189/2260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:04.210564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:04.211194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:04.217301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.217818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.218748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.219179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.345385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:04.353214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b104ee90-89e2-47f7-8cb5-440997c991a5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146454 Aug 03 09:55:04.353797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1072/2261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:04 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:04.843347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:04.844011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:04.844394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:04.844512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:04.850555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.850720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.850998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.851114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.851752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.851858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:04.852179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.852285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:04.913978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:04.921999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5a228571-d9aa-47d1-bf7f-6c6da1db5174 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082521 Aug 03 09:55:04.922571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1190/2262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:04.986523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:04.994916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:04.996416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:04.997668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-679d945b-7c39-4520-9861-73243e6796db tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158318 Aug 03 09:55:04.998219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1073/2263] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:04 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:05.375023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:05.375634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:05.381731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:05.382177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:05.382932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:05.383361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:05.511156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:05.519945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5320fb17-5831-4dbb-a166-ad46bd879b13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149000 Aug 03 09:55:05.520511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1191/2264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:05.943294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:05.943904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:05.950640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:05.951088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:05.951948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:05.952396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:06.013167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:06.019655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:06.020300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:06.021211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-878b79f0-32b8-4011-adc2-18be97223c52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081771 Aug 03 09:55:06.021789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1074/2265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:06.026701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:06.027150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:06.027905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:06.028346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:06.158808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:06.167198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:06.168714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:06.169895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c564ee11-b6b8-4e28-b5e7-f8e66c858662 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154142 Aug 03 09:55:06.170958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1192/2266] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:06 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:06.541290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:06.541904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:06.548604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:06.549077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:06.549865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:06.550332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:06.680079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:06.688107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35ad700f-2077-4c59-a385-0df8fc185e16 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150707 Aug 03 09:55:06.688675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1075/2267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:07.042177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:07.042701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:07.049902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.050351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.051113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.051551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.113316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:07.121272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-34fdd7fc-3116-4259-81c8-cc1d6c8ca184 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083022 Aug 03 09:55:07.121830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1193/2268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:07.192450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:07.193102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:07.199798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.200236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.201023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.201451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.337505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:07.346719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:07.348208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:07.349379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-441e6223-e065-4870-b857-510dc43c006c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.160752 Aug 03 09:55:07.349929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1076/2269] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:07 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:07.709647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:07.710266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:07.716408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.716883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.718260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:07.718694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:07.843724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:07.845948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:07.852964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4876bced-03a2-4280-bbe1-eb39616e44ee tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147135 Aug 03 09:55:07.853529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1194/2270] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:07 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:08.142426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:08.143032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:08.149126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.149568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.150319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.150761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.215030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:08.223789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b118596-55e2-4a93-900b-883e9d669931 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085683 Aug 03 09:55:08.224455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1077/2271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:08.372840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:08.373483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:08.380246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.380690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.381465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.381895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.515643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:08.524049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:08.525603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:08.526757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7dac6f5e-fdc4-4d52-a107-5c86a06e73d5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.157927 Aug 03 09:55:08.527311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1195/2272] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:08 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:08.874574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:08.875174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:08.881210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.881647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.882388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:08.882808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:08.886705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:09.012240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:09.021019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a0c1fc1-91a5-42ec-8599-20441cf54a93 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150398 Aug 03 09:55:09.021571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1078/2273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:08 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:09.245193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:09.245726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:09.252486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:09.252998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:09.253752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:09.254182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:09.315502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:09.324070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c86e5cbb-933b-4720-929c-9063e090d263 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082822 Aug 03 09:55:09.324634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1196/2274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:09.551290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:09.551855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:09.558479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:09.558930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:09.559684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:09.560116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:09.686961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:09.695292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:09.697067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:09.698213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b1bae23-1485-45fa-8301-0d07477eeb88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150881 Aug 03 09:55:09.698768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1079/2275] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:09 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:10.043519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:10.044118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:10.051550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.052127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.052980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.053409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.179931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:10.187870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17c5cfff-0f0e-4321-a031-48e64b54f872 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148218 Aug 03 09:55:10.188424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1197/2276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:10.345243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:10.345805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:10.351763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.352201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.352974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.353403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.413854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:10.421936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1a92455d-286e-4d16-b9a9-b919a1f4a6cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081436 Aug 03 09:55:10.422499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1080/2277] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:10.720757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:10.721388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:10.727653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.728092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.728887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:10.729325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:10.872592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:10.881480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:10.882968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:10.884104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32932790-3e40-4978-849c-f2ada73daed2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.167525 Aug 03 09:55:10.884648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1198/2278] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:10 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:11.209110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:11.209711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:11.216179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.216627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:11.217430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.217858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:11.347351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:11.355262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-53d745c9-fe2b-469a-bd6f-c4d784a54e31 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150026 Aug 03 09:55:11.355825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1081/2279] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:11 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:11.442755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:11.443362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:11.450058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.450505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:11.451252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.451880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:11.513036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:11.520969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5aca2774-b5f2-41b8-ba15-16db5f954b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082111 Aug 03 09:55:11.521525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1199/2280] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:11.908361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:11.909036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:11.915127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.915603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:11.916361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:11.916799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:12.042061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:12.051064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:12.052596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:12.053788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-630f8371-f243-4756-8ed7-2f6ee591a5cf tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149992 Aug 03 09:55:12.054349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1082/2281] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:11 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:12.376789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:12.377422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:12.383433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:12.383884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:12.384638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:12.385096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:12.509199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:12.517259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a911055a-e97f-4e62-b47e-379d1af956ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.144304 Aug 03 09:55:12.517823 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1200/2282] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:12.541885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:12.542517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:12.549569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:12.550010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:12.550786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:12.551243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:12.612384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:12.620210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-460d2d9e-5395-46bc-ba42-169c761c8e29 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082084 Aug 03 09:55:12.620766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1083/2283] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:13.079108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:13.079722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:13.085792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.086241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.087002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.087435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.216839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:13.225453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:13.226956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:13.228102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-904c3252-d318-4b4b-8ebf-1295904277c0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153616 Aug 03 09:55:13.228659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1201/2284] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:13 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:13.538778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:13.539383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:13.545469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.546067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.546817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.547242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.641153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:13.641765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:13.648089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.648530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.649320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:13.649748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:13.678538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:13.687476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7e251996-338b-4c51-91ac-f08f8a852192 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152486 Aug 03 09:55:13.688057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1084/2285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:13.711752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:13.719735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-347ab9e1-98b8-4dbe-b2d3-74301777c44a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082895 Aug 03 09:55:13.720293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1202/2286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:14.250922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:14.251528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:14.257616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.258060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.258817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.259249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.386801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:14.395783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:14.397317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:14.398507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a8fa1004-5205-42dc-a44e-c7907a7cfdf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151632 Aug 03 09:55:14.399068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1085/2287] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:14 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:14.709195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:14.709805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:14.715818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.716258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.717071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.717485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.740821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:14.741431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:14.747804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.748244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.749608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:14.750039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:14.813414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:14.821516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c54ad857-469c-47c8-a156-4d5fea8f153d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084242 Aug 03 09:55:14.822080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1086/2288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:14.850954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:14.859558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-29b6ed6c-e824-4f66-b4d5-b13669e90193 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154438 Aug 03 09:55:14.860127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1203/2289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:14 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:15.422940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:15.423544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:15.429896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.430372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:15.431121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.431545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:15.562005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:15.570381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:15.572142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:15.573334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3f354974-84b6-430f-ac7c-2e7feb329100 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155358 Aug 03 09:55:15.573890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1087/2290] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:15 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:15.843937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:15.844492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:15.850920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.851371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:15.852127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.852563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:15.880520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:15.881147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:15.887648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.888086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:15.888851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:15.889715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:16.029462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:16.038440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f6a7411-a7ec-4b97-b8cd-f25665f0c066 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.161741 Aug 03 09:55:16.039022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1088/2291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:15 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:16.142620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:16.150530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2e25649b-dccf-4069-b7e4-09949a0fe971 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.311018 Aug 03 09:55:16.151086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1204/2292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:16.596567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:16.597208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:16.603233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:16.603682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:16.604442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:16.604908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:16.736428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:16.744765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:16.746300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:16.747457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9b64aaf-1bf9-44f3-a82e-6d07748dc01d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155494 Aug 03 09:55:16.748009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1089/2293] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:16 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:17.061250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:17.061979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:17.068433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.068914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.069666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.070095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.171157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:17.171763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:17.178125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.178566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.179321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.179748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.196676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:17.205126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b150b242-8ff4-4faf-bf14-5a08e1fbeea8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147959 Aug 03 09:55:17.205691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1205/2294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:17.241427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:17.249190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-209b5744-5a9f-425b-87d4-1446d12931c3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081959 Aug 03 09:55:17.249750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1090/2295] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:17.770928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:17.771537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:17.777570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.778013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.778764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:17.779194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:17.906263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:17.914543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:17.916066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:17.917259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dee85e5a-86f5-49d4-a184-a6ffe48b27e2 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150159 Aug 03 09:55:17.917813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1206/2296] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:17 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:18.226190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:18.226773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:18.233852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.234287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:18.235030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.235454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:18.269782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:18.270395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:18.277001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.277446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:18.278197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.278688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:18.344620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:18.352598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-491837f5-b3f4-4bed-93da-f346387fb32d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086492 Aug 03 09:55:18.353187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1207/2297] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:18.368240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:18.376730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-124ff22a-efda-442b-8c2d-df183a6a08c0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154408 Aug 03 09:55:18.377364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1091/2298] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:18 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:18.941490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:18.942098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:18.948376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.948839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:18.949587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:18.950016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:19.078648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:19.087363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:19.088897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:19.090039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2094c977-2ce5-4169-be1e-239931f29d4b tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153217 Aug 03 09:55:19.090593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1208/2299] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:18 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:19.374844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:19.375463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:19.382027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:19.382471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:19.383235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:19.383668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:19.397635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:19.398246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:19.405566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:19.406053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:19.406829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:19.407265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:19.452100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:19.460215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f01c668-c13e-4898-9290-17e82e042aa0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.089960 Aug 03 09:55:19.460789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1092/2300] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:19.541855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:19.549840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8599e2bf-d3a2-4c1d-ab2e-ca558cbc9e69 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156013 Aug 03 09:55:19.550404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1209/2301] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:20.113365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:20.113962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:20.119932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.120372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.121170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.121598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.247290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:20.256149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:20.257663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:20.258808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-17cf8477-6ba8-4aad-bf4f-c84299471d34 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.149330 Aug 03 09:55:20.259352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1093/2302] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:20 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:20.481059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:20.481682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:20.488265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.488719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.489508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.489946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.550348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:20.558376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a85a9fce-0611-42c4-bbe3-1e0906d00838 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081187 Aug 03 09:55:20.558946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1210/2303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:20.570978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:20.571844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:20.578970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.579409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.580156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:20.580580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:20.707360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:20.709540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:20.716598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74f05fdf-a215-4a9f-8c55-0506268ee6b2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149356 Aug 03 09:55:20.717770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1094/2304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:21.283109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:21.283716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:21.289941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.290387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.291139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.291567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.306687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:21.421568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:21.429971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:21.431494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:21.432630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d05b5cbc-42dc-4588-9a5b-d7dc17088fa0 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.153977 Aug 03 09:55:21.433230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1211/2305] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:21 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:21.580301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:21.580862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:21.587283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.587718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.588457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.588917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.654414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:21.662825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-65029b14-fef8-452d-91f6-fcfd38b97d27 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086957 Aug 03 09:55:21.663400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1095/2306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:21.737773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:21.738386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:21.744862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.745311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.746061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:21.746494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:21.877291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:21.885105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb88a105-56db-447e-9df4-f277f23f736e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151132 Aug 03 09:55:21.885665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1212/2307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:21 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:22.456360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:22.456998 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:22.463074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.463522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:22.464279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.464713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:22.589358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:22.597948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:22.599443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:22.600657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-544f917b-b30c-42be-a2b3-4f977e4a15fb tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.148232 Aug 03 09:55:22.601245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1096/2308] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:22 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:22.683397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:22.684009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:22.691039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.691507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:22.692261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.692693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:22.755194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:22.763106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c34f5db-8e05-47ea-abef-ad00ed40fea4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083555 Aug 03 09:55:22.763661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1213/2309] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:22.906276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:22.906882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:22.912901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.913351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:22.914103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:22.914532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:23.041752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:23.051232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-11ff70b7-3f24-45fd-a0b9-0cd5a6136a0c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148682 Aug 03 09:55:23.051232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1097/2310] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:22 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:23.624783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:23.625406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:23.631364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:23.631805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:23.632544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:23.633011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:23.763866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:23.772794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:23.774347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:23.775495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-313b58a8-3289-4a49-8c7b-75b14e655e8e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155412 Aug 03 09:55:23.776055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1214/2311] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:23 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:23.784093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:23.784696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:23.791213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:23.791650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:23.792397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:23.792839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:23.857079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:23.865540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b59aab3-952b-454c-b2d8-a31fc10fb765 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085274 Aug 03 09:55:23.866097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1098/2312] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:24.071729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:24.072338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:24.078469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.078913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.079657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.080247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.206479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:24.215169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4ad37ca7-a616-4f4e-abc3-c42d55406710 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147550 Aug 03 09:55:24.215741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1215/2313] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:24.800273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:24.800898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:24.807303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.807743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.808516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.808972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.886882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:24.887480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:24.894650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.895101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.895873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:24.896309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:24.939364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:24.948023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:24.949562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:24.950734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8a37c3dc-8710-487b-95b2-5738d15c10de tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.154369 Aug 03 09:55:24.951362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1099/2314] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:24 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:24.960291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:24.968878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f391a24-9904-46e6-90a7-703bcd9986f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085896 Aug 03 09:55:24.969449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1216/2315] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:25.237506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:25.238123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:25.244220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.244670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:25.245457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.245893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:25.373641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:25.381551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3136840b-b5a8-441f-8879-d13712650a1a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148717 Aug 03 09:55:25.382111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1100/2316] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:25 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:25.974360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:25.974913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:25.981385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.981834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:25.983212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.983660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:25.989747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:25.990390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:25.996505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.996985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:25.997743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:25.998192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:26.066670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:26.074979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4ff350e-7b37-403d-a6ea-9368998c5d66 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.089058 Aug 03 09:55:26.075553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1101/2317] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:26.117798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:26.126220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:26.127730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:26.128907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcf4e98d-4f69-49e8-b17d-89ff8dfba90e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.158536 Aug 03 09:55:26.129471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1217/2318] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:25 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:26.402457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:26.403067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:26.410070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:26.410510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:26.411269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:26.411696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:26.540214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:26.548099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c67c2757-fe65-471c-9ebc-f7e9f239dd74 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149492 Aug 03 09:55:26.548660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1102/2319] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:27.097789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:27.098553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:27.105045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.105489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.106240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.106672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.151686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:27.152278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:27.159449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.159888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.160638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.161086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.169042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:27.177791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1305e511-6ac9-46b9-a51f-6321c782e73d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083863 Aug 03 09:55:27.178364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1218/2320] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:27.286982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:27.295270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:27.297695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:27.298844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9c315182-bd8e-4f4a-9cdf-df08a6c6a59a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151104 Aug 03 09:55:27.299408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1103/2321] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:27 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:55:27.303638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:55:27.303797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:55:27.570014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:27.570626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:27.577535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.577933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.578688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:27.579131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:27.705511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:27.713392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9a6e3991-ac9b-4ac6-b9d8-074c5b8eb638 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147243 Aug 03 09:55:27.713952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1219/2322] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:28.199336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:28.199934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:28.206883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.207321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.208068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.208490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.273027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:28.281790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-901bfc0d-0d37-418c-b095-6474e7bbc9a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086631 Aug 03 09:55:28.282335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1104/2323] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:28.323270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:28.323806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:28.330891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.331327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.332080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.332507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.463416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:28.472876 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:28.474408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:28.475560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-797888a8-8d77-4394-af02-17736c37a17a tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.156505 Aug 03 09:55:28.476117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1220/2324] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:28 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:28.734243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:28.734862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:28.740939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.741384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.742140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:28.742574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:28.871248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:28.879733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35ad8061-09d5-46e7-bcc7-c014239b7860 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149356 Aug 03 09:55:28.880289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1105/2325] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:28 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:29.302659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:29.303266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:29.309312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.309731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:29.310483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.310915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:29.371987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:29.380613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cfc8a7e8-a960-48ff-ad70-da0636d7366f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081805 Aug 03 09:55:29.381211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1221/2326] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:29.497903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:29.498501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:29.505243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.505679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:29.506426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.506855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:29.633272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:29.641607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:29.643098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:29.644235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-55af2049-d4ca-4583-9645-463d12621c7e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.150227 Aug 03 09:55:29.644781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1106/2327] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:29 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:29.901146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:29.901756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:29.908391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.908849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:29.909598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:29.910025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:30.155456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:30.163339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6de89e0b-33fc-43ff-82b5-d1dd3abf8917 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.266030 Aug 03 09:55:30.163910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1222/2328] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:29 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:30.401281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:30.401892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:30.408135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:30.408525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:30.409314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:30.409749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:30.473747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:30.481681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cba5a829-b6d4-4c7b-8ca2-41afe91c35b2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084224 Aug 03 09:55:30.482242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1107/2329] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:30.667484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:30.668008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:30.675343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:30.675785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:30.676522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:30.676994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:30.807005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:30.816023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:30.817565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:30.818714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff16be6a-d628-407a-b088-adff77321b74 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.155163 Aug 03 09:55:30.819268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1223/2330] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:31.183402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:31.184008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:31.191046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.191487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.192231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.192664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.319895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:31.328334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b8c08eda-5c11-4927-af11-fb324d45e8f7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148727 Aug 03 09:55:31.328915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1108/2331] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:31 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:31.502817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:31.503419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:31.509414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.509858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.510608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.511034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.571494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:31.579703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c41350a-031a-4679-b5b2-d8a1de097a84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081280 Aug 03 09:55:31.580249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1224/2332] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:31.843736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:31.844256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:31.851196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.851639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.852390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:31.852835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:31.979072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:31.988016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:31.989579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:31.990772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae8916b4-14e6-4a5f-9ff5-db9bce06be54 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1802 microversion: 2.20 time: 0.151552 Aug 03 09:55:31.991334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1109/2333] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1802 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:32.013295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-edccac52-dd73-4150-9c86-85ed465d3ad7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '.version_select at 0x7fb998d205e0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:32.033667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-edccac52-dd73-4150-9c86-85ed465d3ad7 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604167293" status: 204 len: 0 microversion: 2.20 time: 0.024128 Aug 03 09:55:32.034223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1225/2334] 10.222.0.20 () {60 vars in 1262 bytes} [Wed Aug 3 09:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604167293 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 09:55:32.350502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:32.351104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:32.353418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=82 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:32.358981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:32.359426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:32.360237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:32.360725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:32.554001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:32.565458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-28956bb3-6ab9-42c8-a49f-31e6048e1c17 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.218689 Aug 03 09:55:32.566034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1110/2335] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:32.600260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:32.600920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:32.607576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:32.608425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:32.609239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:32.609755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:32.674683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:32.693452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e6cf689-6fa8-4fb8-90f1-0acf163b39f2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087045 Aug 03 09:55:32.695032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1226/2336] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:33.200043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-52687ec3-88b5-454c-8eae-c1f030c21550 req-876854bd-ae3e-4d08-a1a5-781a00deea5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:33.211306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-52687ec3-88b5-454c-8eae-c1f030c21550 req-876854bd-ae3e-4d08-a1a5-781a00deea5f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:33.211742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-52687ec3-88b5-454c-8eae-c1f030c21550 req-876854bd-ae3e-4d08-a1a5-781a00deea5f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:33.225389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-52687ec3-88b5-454c-8eae-c1f030c21550 req-876854bd-ae3e-4d08-a1a5-781a00deea5f service nova] Creating event network-changed:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:55:33.232163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-52687ec3-88b5-454c-8eae-c1f030c21550 req-876854bd-ae3e-4d08-a1a5-781a00deea5f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144986 Aug 03 09:55:33.233574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1111/2337] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:55:33.244487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-acd49439-d793-4c4b-8e36-9c3b52a01a71 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'create', calling method: .version_select at 0x7fb998c764c0>, body: {"keypair": {"name": "tempest-keypair-99883284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnrXHlr/znRH/nGkDivQm1WKGj05rAVPAPhvT+MJ0xU0rYdQTUutIutysiZbFB40DW1meYQi4kvkBvOT0Ml1ONBHAfXzhIuFDCSjoKx3Xrqt6TtThCqANWBQH2sqLahjw=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:33.252620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:33.267525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-acd49439-d793-4c4b-8e36-9c3b52a01a71 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for project 3a4f922101d8435d977a4df9843338e8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:55:33.271542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-acd49439-d793-4c4b-8e36-9c3b52a01a71 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for user 317467d6f856435f8f7eee33eb92c6e3 and project 3a4f922101d8435d977a4df9843338e8. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:55:33.293744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-acd49439-d793-4c4b-8e36-9c3b52a01a71 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.053129 Aug 03 09:55:33.299965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1227/2338] 10.222.0.20 () {62 vars in 1200 bytes} [Wed Aug 3 09:55:33 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 03 09:55:33.589193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:33.590581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:33.598141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:33.598973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:33.599955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:33.600623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:33.629158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:33.716262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:33.716262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:33.722877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:33.723634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:33.724590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:33.725213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:33.841469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:33.854297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f81b7f17-7184-4fdc-89b8-30ac6a5f1b62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.142294 Aug 03 09:55:33.855780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1228/2339] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:34.112924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:34.121630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-75ca7917-f90a-4839-b8bc-fa32ea258b62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.537578 Aug 03 09:55:34.122207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1112/2340] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:34.876742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:34.877388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:34.883568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:34.884023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:34.884783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:34.885413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:34.956770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:34.964804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b08ef8a-2515-4736-9dcb-39a36e981f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.091877 Aug 03 09:55:34.965350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1229/2341] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:35.144047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:35.144676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:35.150796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.151230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.151980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.152402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.190509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-699214950", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f361acc-01c0-4f7c-89aa-cea2be3ec17f"}], "security_groups": [{"name": "tempest-securitygroup--236923380"}], "key_name": "tempest-keypair-99883284", "user_data": "}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:35.294073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:35.301480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] validate_networks() for [('2f361acc-01c0-4f7c-89aa-cea2be3ec17f', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 09:55:35.303583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a26c9121-1719-4a9b-a55c-e8ffd5014628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.163429 Aug 03 09:55:35.304246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1113/2342] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:35 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:35.309136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-9aaf7f1a-543e-424f-853d-4a7c3c9a213b req-dca77af2-527b-4b79-86b9-306b5126590f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30c986d-ad83-45a8-b4e6-96d056aaa6d5", "name": "network-vif-deleted", "tag": "6c4ed275-12af-431c-bcaf-a4b506ad02ef"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:35.319383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-9aaf7f1a-543e-424f-853d-4a7c3c9a213b req-dca77af2-527b-4b79-86b9-306b5126590f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.319823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-9aaf7f1a-543e-424f-853d-4a7c3c9a213b req-dca77af2-527b-4b79-86b9-306b5126590f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.331432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-9aaf7f1a-543e-424f-853d-4a7c3c9a213b req-dca77af2-527b-4b79-86b9-306b5126590f service nova] Creating event network-vif-deleted:6c4ed275-12af-431c-bcaf-a4b506ad02ef for instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 on hv-cinder-84456 Aug 03 09:55:35.336655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-9aaf7f1a-543e-424f-853d-4a7c3c9a213b req-dca77af2-527b-4b79-86b9-306b5126590f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031172 Aug 03 09:55:35.337707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1114/2343] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:55:35.723220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 09:55:35.723669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 09:55:35.724124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 09:55:35.724528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 09:55:35.724954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 09:55:35.734118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.734475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.735253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.735679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.742179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:35.753352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for project 3a4f922101d8435d977a4df9843338e8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 09:55:35.757416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Getting quotas for user 317467d6f856435f8f7eee33eb92c6e3 and project 3a4f922101d8435d977a4df9843338e8. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 09:55:35.768301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 09:55:35.770535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 09:55:35.813707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [388fe109-20ba-4048-892d-c55859df15ff] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 09:55:35.986594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:35.987212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:35.993363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.993800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:35.994542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:35.995001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:36.056417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:36.064716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bc279fb0-f60a-4cd4-9397-1c0bb55758bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082377 Aug 03 09:55:36.065314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1115/2344] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:36.324624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:36.325359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:36.331691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:36.332130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:36.332906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:36.333336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:36.464491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:36.473105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dce0eb50-2513-4b23-bc99-7e4d2d72ec90 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152550 Aug 03 09:55:36.473672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1116/2345] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:36.820361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [388fe109-20ba-4048-892d-c55859df15ff] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 41856. Aug 03 09:55:36.824905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-84d7992c-5293-42a0-aec9-0012f6745369 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.638746 Aug 03 09:55:36.825560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1230/2346] 10.222.0.20 () {62 vars in 1188 bytes} [Wed Aug 3 09:55:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 03 09:55:36.837112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:36.837652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:36.893979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:36.902304 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:36.903819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:36.905672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5db44b19-238c-4cd3-97c5-7239577d18f4 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1279 microversion: 2.20 time: 0.071795 Aug 03 09:55:36.906247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1117/2347] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:36 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1279 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:37.086572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:37.087232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:37.095108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.095664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:37.096626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.097096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:37.167294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:37.175771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7028ad91-9205-4d03-8d29-d1208860a02e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.093585 Aug 03 09:55:37.188841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1231/2348] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:37.494958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:37.495542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:37.502587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.503029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:37.503773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.504202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:37.630202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:37.638043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe582fe8-e8a7-4cae-bc51-80e021fd67ce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146974 Aug 03 09:55:37.638603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1118/2349] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:37.928009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:37.929212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:37.937199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.937731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:37.938561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:37.939002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:38.000919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:38.009050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:38.010572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:38.011696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ad342b54-9811-46eb-89b7-8ca11cf74c88 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1337 microversion: 2.20 time: 0.088191 Aug 03 09:55:38.012257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1232/2350] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:37 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:38.199450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:38.200033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:38.207764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:38.208559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:38.209760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:38.210363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:38.294294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:38.304568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6021d364-8cdf-43b6-a255-dc853471b219 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.109363 Aug 03 09:55:38.307144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1119/2351] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:38.661245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:38.661789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:38.668552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:38.669039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:38.669812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:38.670248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:38.804359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:38.812867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0cde49b9-c257-4298-ae3b-bd67956fc42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155342 Aug 03 09:55:38.813465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1233/2352] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:39.034570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:39.035185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:39.041874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.042422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.043261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.043773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.287709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:39.298737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:39.300268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:39.301416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5cf9c42-e0f2-42e9-b59f-915599f7d09e tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.271056 Aug 03 09:55:39.301971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1120/2353] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:39 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:39.325798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:39.326501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:39.333193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.333642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.334418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.334857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.396201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:39.407187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f5ac95b3-297d-4f19-9f76-2c12476ead38 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085460 Aug 03 09:55:39.407729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1234/2354] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:39.423273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-24b9b057-e967-421c-a488-27f990f9fe6f req-1a9c5c39-0c25-40e1-b23e-6fef2c57e32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b58105a-872a-493e-b343-a257e90d24b2", "tag": "6bd32305-82b6-4ada-8bcf-6d32288ef6ac"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:39.435834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-24b9b057-e967-421c-a488-27f990f9fe6f req-1a9c5c39-0c25-40e1-b23e-6fef2c57e32f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.436894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-24b9b057-e967-421c-a488-27f990f9fe6f req-1a9c5c39-0c25-40e1-b23e-6fef2c57e32f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.448318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-24b9b057-e967-421c-a488-27f990f9fe6f req-1a9c5c39-0c25-40e1-b23e-6fef2c57e32f service nova] Creating event network-changed:6bd32305-82b6-4ada-8bcf-6d32288ef6ac for instance 3b58105a-872a-493e-b343-a257e90d24b2 on hv-cinder-84456 Aug 03 09:55:39.453149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-24b9b057-e967-421c-a488-27f990f9fe6f req-1a9c5c39-0c25-40e1-b23e-6fef2c57e32f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036083 Aug 03 09:55:39.453755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1121/2355] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 09:55:39.835446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:39.836060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:39.844011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.845036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.845796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:39.846230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:39.981805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:39.989664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-60c53ad5-0731-4fc7-a7d4-504e27c14578 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158127 Aug 03 09:55:39.990225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1235/2356] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:40.325483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:40.326177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:40.332442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:40.332921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:40.333671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:40.334093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:40.427678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:40.428317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:40.434319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:40.434769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:40.435528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:40.436020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:40.464654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:40.473256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:40.474959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:40.476161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f7aef932-2e14-4924-a7ba-a0c0076c5b13 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.155845 Aug 03 09:55:40.476726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1122/2357] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:40 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:40.499209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:40.507079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-788f82f8-a770-47aa-ad59-a718d4192d10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083308 Aug 03 09:55:40.507643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1236/2358] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:41.010945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:41.011585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:41.017838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.018288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.019054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.019492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.187381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:41.195279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e52c9158-fc6c-488e-b0c7-3781764f8f23 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.188316 Aug 03 09:55:41.195833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1123/2359] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:41.499782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:41.500394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:41.506843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.507286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.508034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.508463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.527420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:41.528057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:41.534862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.535306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.536054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:41.536484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:41.602156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:41.610197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-06987bc6-0005-4e54-b8fc-34f682cd9536 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086589 Aug 03 09:55:41.610761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1124/2360] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:41.641651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:41.649517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:41.651014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:41.652091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72b59c57-bdc0-41d4-af3a-161254bf68fa tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.157004 Aug 03 09:55:41.652640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1237/2361] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:41 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:42.217642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:42.218261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:42.226256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.226664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.227441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.227875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.383729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:42.392537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6c79a1b8-eacb-46c0-94ac-34769006f61f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.179555 Aug 03 09:55:42.393137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1125/2362] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:42 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:42.632324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:42.633027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:42.643253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.644009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.644934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.646081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.675941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:42.676563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:42.683284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.683731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.684510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:42.684971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:42.715946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:42.724170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fabbab1f-49a5-4681-80d5-94eae914d220 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.096723 Aug 03 09:55:42.724999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1238/2363] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:42.820327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:42.828510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:42.830031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:42.831117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48968dca-3079-4b79-9cca-962c6773b1a9 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.159793 Aug 03 09:55:42.831663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1126/2364] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:42 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 03 09:55:43.413595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:43.414204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:43.420194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.421168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.421915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.422340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.547277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:43.555148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb7cfd0e-5b03-4e32-a665-233cdc121f6c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.145373 Aug 03 09:55:43.555884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1239/2365] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:43.745444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:43.746043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:43.753721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.754162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.754913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.755341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.818250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:43.826309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f6529425-6795-4513-a83a-fad1736d24f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084737 Aug 03 09:55:43.827488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1127/2366] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:43.852119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:43.852749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:43.859619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.860060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.860803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:43.861259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:43.992698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:44.001537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:44.003291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:44.004419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-865ac3cf-4e62-4c32-9a2a-78305f1b89b1 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.156195 Aug 03 09:55:44.005158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1240/2367] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:43 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:44.146385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-e5c1abb5-c7b7-4f69-bb4c-e35e1e9a9618 req-5f9b813e-9fb3-4f89-92c4-6892303aeafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b58105a-872a-493e-b343-a257e90d24b2", "name": "network-vif-plugged", "status": "completed", "tag": "6bd32305-82b6-4ada-8bcf-6d32288ef6ac"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:44.156140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e5c1abb5-c7b7-4f69-bb4c-e35e1e9a9618 req-5f9b813e-9fb3-4f89-92c4-6892303aeafa service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:44.156582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-e5c1abb5-c7b7-4f69-bb4c-e35e1e9a9618 req-5f9b813e-9fb3-4f89-92c4-6892303aeafa service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:44.167258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-e5c1abb5-c7b7-4f69-bb4c-e35e1e9a9618 req-5f9b813e-9fb3-4f89-92c4-6892303aeafa service nova] Creating event network-vif-plugged:6bd32305-82b6-4ada-8bcf-6d32288ef6ac for instance 3b58105a-872a-493e-b343-a257e90d24b2 on hv-cinder-84456 Aug 03 09:55:44.172600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-e5c1abb5-c7b7-4f69-bb4c-e35e1e9a9618 req-5f9b813e-9fb3-4f89-92c4-6892303aeafa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089274 Aug 03 09:55:44.173217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1128/2368] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:55:44.576877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:44.577420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:44.583610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:44.584058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:44.584834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:44.585275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:44.711217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:44.719738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10f312e8-99c1-4c49-bb44-fbb6cb75488b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146908 Aug 03 09:55:44.720303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1241/2369] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:44.849024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:44.849716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:44.855885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:44.856322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:44.857085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:44.857514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:44.919119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:44.927525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9b0b64f4-1e53-403d-8fba-8eefea8b05a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083185 Aug 03 09:55:44.928090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1129/2370] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:45.027006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:45.027619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:45.033993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.034435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:45.035176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.035605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:45.163780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:45.172359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:45.173867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:45.174949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bcd59451-ea3c-4c95-a431-89a885be6f43 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1404 microversion: 2.20 time: 0.151886 Aug 03 09:55:45.175507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1242/2371] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:45 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:45.740436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:45.741073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:45.747307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.747754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:45.748803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.748803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:45.880888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:45.888890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8d2fdc4c-27ba-4dad-af6a-1460b1ac5e4b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152287 Aug 03 09:55:45.890033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1130/2372] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:45.948981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:45.949607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:45.952591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:45.953330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=10 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:45.958896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.959338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:45.960085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:45.960520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.024390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:46.032192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0cbeb09-4aa4-466c-91d5-965c86095812 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087320 Aug 03 09:55:46.032770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1243/2373] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:46.197577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:46.198174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:46.205768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.206221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.206991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.207427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.337023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:46.339307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:46.346547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:46.348053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:46.349254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e034131a-7354-407c-ab76-6a08d1084284 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1595 microversion: 2.20 time: 0.155890 Aug 03 09:55:46.349809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1131/2374] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:55:46 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:55:46.372091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:46.372577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:46.379147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.379586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.380326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.380753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.458464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-227748f4-ca57-4b02-b037-6a6878bdd157 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090181 Aug 03 09:55:46.459056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1244/2375] 10.222.0.20 () {60 vars in 1316 bytes} [Wed Aug 3 09:55:46 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:55:46.912060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:46.912669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:46.916303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:46.921542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.922210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:46.923167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:46.923710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:47.052871 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:47.053761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:47.061557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:47.062336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:47.063351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:47.063917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:47.070583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:47.080135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d26010ab-c805-401b-bbb8-2832e864eb5e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.172172 Aug 03 09:55:47.080891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1132/2376] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:47.135854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:47.144300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1138a7d6-7fc0-4065-9fa0-715effb1a130 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.095354 Aug 03 09:55:47.144903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1245/2377] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:47 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:47.627306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-b1ca049e-2a7c-4af4-9537-63501ae00845 req-234da23d-cb56-4f66-a000-c368d060bab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b58105a-872a-493e-b343-a257e90d24b2", "tag": "6bd32305-82b6-4ada-8bcf-6d32288ef6ac"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:55:47.636791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b1ca049e-2a7c-4af4-9537-63501ae00845 req-234da23d-cb56-4f66-a000-c368d060bab8 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:47.637325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b1ca049e-2a7c-4af4-9537-63501ae00845 req-234da23d-cb56-4f66-a000-c368d060bab8 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:47.651028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-b1ca049e-2a7c-4af4-9537-63501ae00845 req-234da23d-cb56-4f66-a000-c368d060bab8 service nova] Creating event network-changed:6bd32305-82b6-4ada-8bcf-6d32288ef6ac for instance 3b58105a-872a-493e-b343-a257e90d24b2 on hv-cinder-84456 Aug 03 09:55:47.656007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-b1ca049e-2a7c-4af4-9537-63501ae00845 req-234da23d-cb56-4f66-a000-c368d060bab8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033069 Aug 03 09:55:47.656702 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1133/2378] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:55:48.102359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:48.103844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:48.112187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:48.113365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:48.113554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:48.114085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:48.166812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:48.168235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:48.176704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:48.177633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:48.178630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:48.190716 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:48.260127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:48.269469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0dc147d6-dcb7-4c55-8b83-bad64d3c7b9c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.171021 Aug 03 09:55:48.270351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1246/2379] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:48 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:48.277063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:48.286180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7652fa85-8d9d-4812-88b9-cb2bdcb85500 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.124713 Aug 03 09:55:48.286794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1134/2380] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:49.291762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:49.292375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:49.299625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:49.300064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:49.300824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:49.301274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:49.307494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:49.308039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:49.315354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:49.315804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:49.316560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:49.317034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:49.379466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:49.387744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9cff372d-4a51-43f1-9a99-3c7e7b097ee7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084118 Aug 03 09:55:49.388310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1135/2381] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:49.437180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:49.439385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:55:49.446535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-89bd7121-80cf-43a8-9e0c-6a0eec4d717b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158689 Aug 03 09:55:49.447106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1247/2382] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:49 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:50.409689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:50.410298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:50.416838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:50.417298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:50.418051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:50.418480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:50.467548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:50.468157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:50.475209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:50.475652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:50.476404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:50.476852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:50.480111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:50.488260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9332abd-47a6-470d-acbd-f4e247ee6459 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083370 Aug 03 09:55:50.488863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1136/2383] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:50.603905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:50.612136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-57bdd1bf-1341-40ce-9111-6707ff0104fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148587 Aug 03 09:55:50.612705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1248/2384] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:51.509431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:51.510111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:51.516676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:51.517141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:51.517887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:51.518311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:51.579472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:51.587324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a4b5436-8000-4598-8826-740ffeb9bbfe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081778 Aug 03 09:55:51.587853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1137/2385] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:51.633304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:51.633949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:51.640404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:51.640884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:51.642183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:51.642625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:51.771661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:51.779499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-469874f5-d7bc-4a71-881d-1ebd5ea7e752 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150038 Aug 03 09:55:51.780060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1249/2386] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:52.607480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:52.608089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:52.614822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:52.615270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:52.616031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:52.616465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:52.681511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:52.690510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3776a7a0-91ab-4b85-9466-e556f9977be8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086884 Aug 03 09:55:52.691079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1138/2387] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:52.801504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:52.802127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:52.808608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:52.809086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:52.809845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:52.810281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:52.944655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:52.952865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9142dc40-b535-4417-9aef-986937dfb796 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155785 Aug 03 09:55:52.953434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1250/2388] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:53.711739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:53.712373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:53.718482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:53.718926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:53.720396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:53.720867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:53.783444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:53.791353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1f7cfb40-6434-4cb5-9712-7b567e2ca938 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083734 Aug 03 09:55:53.791913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1139/2389] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:53.974611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:53.975269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:53.982461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:53.982931 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:53.983673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:53.984110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:54.113690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:54.121569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12904d42-850c-4aa6-a6d8-35c0a91c253d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150912 Aug 03 09:55:54.122133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1251/2390] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:55:54.811912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:54.812512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:54.819539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:54.819979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:54.820722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:54.821175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:54.882467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:54.890228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f872c889-bbec-476f-bb45-222dbd648df9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082130 Aug 03 09:55:54.890786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1140/2391] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:55.143260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:55.143888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:55.150450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:55.150890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:55.151637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:55.152066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:55.281549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:55.289970 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-95a6b43b-92d7-48fa-a2bf-c064ce50327a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151066 Aug 03 09:55:55.290540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1252/2392] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:55 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:55.912013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:55.912647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:55.919138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:55.919575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:55.920318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:55.920746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:55.981492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:55.990040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-60e29def-eacb-4227-8d36-a62a644f0836 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082028 Aug 03 09:55:55.990595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1141/2393] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:56.311131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:56.311678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:56.318398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:56.318846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:56.319605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:56.320043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:56.452948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:56.461253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6e1908d1-ed39-4766-839b-718f1f6230d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154037 Aug 03 09:55:56.461814 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1253/2394] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:57.011500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:57.012105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:57.019523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:57.019970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:57.020726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:57.021182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:57.085660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:57.093613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b29bd64f-c5ca-48f1-864e-43ab8dbcb349 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085979 Aug 03 09:55:57.094223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1142/2395] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:57.482003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:57.482613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:57.490093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:57.490531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:57.491281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:57.491711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:57.618688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:57.626529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f970c20-d658-47ba-ba54-2315544e4641 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148380 Aug 03 09:55:57.627069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1254/2396] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:58.114188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:58.114789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:58.121290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:58.121730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:58.122474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:58.122900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:58.183591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:58.191847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-301a57fe-5c04-4ab8-8af1-b0f90f74a68b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081509 Aug 03 09:55:58.192620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1143/2397] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:58.647520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:58.648125 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:58.654672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:58.655113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:58.655860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:58.656286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:58.785757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:58.793609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-959f7b72-2232-4478-8812-85cd99ec9b38 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150129 Aug 03 09:55:58.794171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1255/2398] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:59.213159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:59.213768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:59.221033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:59.221470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:59.222221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:59.222647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:59.284088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:59.292030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ebb38e59-8774-4186-b6db-73a96abfb4ae tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082667 Aug 03 09:55:59.292585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1144/2399] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:55:59.815872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:55:59.816516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:55:59.823456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:59.823903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:59.824661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:55:59.825128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:55:59.952933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:55:59.962229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f394192f-e28b-42cc-a9f9-c75fa496089e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150705 Aug 03 09:55:59.962843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1256/2400] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:55:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:00.314201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:00.314889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:00.321518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:00.321960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:00.322972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:00.323402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:00.384758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:00.392879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b355e911-3b54-44b9-946f-334a8b24bb16 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083121 Aug 03 09:56:00.393442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1145/2401] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:00.983035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:00.983646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:00.990740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:00.991184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:00.991938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:00.992376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:01.127524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:01.135383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7b942b2c-6003-4f38-a988-ed3fac347edc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156290 Aug 03 09:56:01.135959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1257/2402] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:01.413894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:01.414503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:01.421268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:01.421703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:01.422460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:01.422905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:01.488985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:01.496995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f6ec7752-0958-41a3-8d79-83985851d297 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086935 Aug 03 09:56:01.497567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1146/2403] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:02.156167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:02.156894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:02.163915 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:02.164354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:02.165126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:02.165557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:02.293797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:02.302264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-60e22921-12b1-4300-a46b-ad2636284b4e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149942 Aug 03 09:56:02.302827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1258/2404] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:02 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:02.517349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:02.517960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:02.520366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=76 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:02.525874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:02.526322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:02.527081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:02.527515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:02.588782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:02.596954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-68e0223e-2cd5-4989-ae11-1eb18ec1180b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083356 Aug 03 09:56:02.597532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1147/2405] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:03.323868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:03.324406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:03.326740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:03.332765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:03.333250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:03.334009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:03.334446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:03.467430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:03.476007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b14c1eea-c7c6-4c29-862b-fdb46226da0f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156418 Aug 03 09:56:03.476575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1259/2406] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:03.617509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:03.618130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:03.624803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:03.625272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:03.626017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:03.626447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:03.687339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:03.695415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73a06d3b-a5a6-44fa-9094-91695c46f241 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081768 Aug 03 09:56:03.695968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1148/2407] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:03.898629 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:56:03.898795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:56:04.497024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:04.497635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:04.505156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:04.505598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:04.506448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:04.506925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:04.635964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:04.644568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-313bf864-e0d6-4380-90eb-95c5b327718a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151439 Aug 03 09:56:04.645162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1260/2408] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:04 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:04.716222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:04.716843 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:04.723573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:04.724017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:04.724769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:04.725222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:04.729080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:04.787381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:04.795104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce6bd3b2-2a19-4041-b73d-bf196f5a397a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082752 Aug 03 09:56:04.795659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1149/2409] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:05.666754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:05.667148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:05.673784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:05.674229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:05.674988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:05.675418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:05.804003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:05.812010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4a75e2e-c871-48eb-a392-d4a23f2eb263 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149607 Aug 03 09:56:05.812572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1261/2410] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:05.815433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:05.816050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:05.822529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:05.823238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:05.824001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:05.824441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:05.887681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:05.895556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6eb88e7e-07dd-4f0b-b60a-f822d03cfe7d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084034 Aug 03 09:56:05.896120 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1150/2411] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:06.833613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:06.834123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:06.840647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:06.841122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:06.841895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:06.842322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:06.917749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:06.918369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:06.925211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:06.925657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:06.926441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:06.926870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:06.975885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:06.984019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6eeaf519-2449-4249-a2e5-ca6a0e736f43 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154384 Aug 03 09:56:06.984590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1262/2412] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:06.988267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:06.996150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7496afd0-1472-4f73-80e5-6109807aff92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082290 Aug 03 09:56:06.996707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1151/2413] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:08.005710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:08.006314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:08.012752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:08.013224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:08.013973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:08.014399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:08.017414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:08.018022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:08.024412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:08.024874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:08.025628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:08.026054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:08.091783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:08.099733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bf742bb2-f920-4ed9-9d53-45389ef38b25 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086087 Aug 03 09:56:08.100302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1152/2414] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:08.148589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:08.156530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-620d24ab-1504-49ab-abd9-c9892d698591 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155408 Aug 03 09:56:08.157121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1263/2415] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:08 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:09.120101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:09.120717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:09.128047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:09.128496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:09.129284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:09.129723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:09.178785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:09.179530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:09.186088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:09.186610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:09.187454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:09.188143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:09.190952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:09.199164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-617c34c0-7571-4cf3-aa92-8f47d74646b0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082977 Aug 03 09:56:09.199738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1153/2416] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:09.204676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:09.321847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:09.330105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b2db4cec-bcab-4cff-88c8-a8a7f329bf95 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155324 Aug 03 09:56:09.330659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1264/2417] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:09 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:10.219509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:10.221176 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:10.227729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:10.228171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:10.228979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:10.229410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:10.293711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:10.302298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6c23d3ac-c7b9-452e-9cc8-6d7069c2ed95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086712 Aug 03 09:56:10.302858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1154/2418] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:10.352003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:10.352619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:10.359209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:10.359690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:10.361446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:10.361669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:10.488147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:10.496788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96487851-9377-4e15-9633-31c68acc6717 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148647 Aug 03 09:56:10.497386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1265/2419] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:11.323965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:11.324496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:11.331015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:11.331452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:11.332197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:11.332622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:11.395586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:11.404003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-91675469-10c9-4c20-bbb0-f9c74eb992bc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084250 Aug 03 09:56:11.404566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1155/2420] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:11.517907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:11.518506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:11.524938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:11.525380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:11.526119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:11.526543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:11.658318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:11.666520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2443350e-3260-4551-b76d-fbf9b2d94aa1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153048 Aug 03 09:56:11.667087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1266/2421] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:11 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:12.425734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:12.426340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:12.432890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:12.433331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:12.434074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:12.434498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:12.495396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:12.504456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-601ab0e6-8249-457b-9eac-714f634dc89a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082634 Aug 03 09:56:12.505061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1156/2422] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:12.687193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:12.687740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:12.695018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:12.695464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:12.696222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:12.696657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:12.828608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:12.837245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a58d77b6-7c2a-41c9-9f50-5e3c0867226c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153909 Aug 03 09:56:12.837809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1267/2423] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:13.525905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:13.526517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:13.533619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:13.534067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:13.534822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:13.535255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:13.596073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:13.603848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5bb4bac3-7efa-430f-ab08-26df8b4dd885 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081831 Aug 03 09:56:13.604415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1157/2424] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:13.858306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:13.858921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:13.865877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:13.866326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:13.867090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:13.867521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:13.994871 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:14.003403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32434043-de8a-4922-a677-6ae6a83e884d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148965 Aug 03 09:56:14.003966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1268/2425] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:14.625179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:14.625797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:14.633154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:14.633600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:14.634464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:14.635110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:14.698699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:14.707022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5e704bb7-174f-4511-986e-e43413f51407 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085719 Aug 03 09:56:14.707570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1158/2426] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:15.023573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:15.024132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:15.030273 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:15.030719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:15.031472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:15.031908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:15.166784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:15.175723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10a0308e-c03a-4e57-aa97-77ef4eac815c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156068 Aug 03 09:56:15.176286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1269/2427] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:15 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:15.727591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:15.728208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:15.734782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:15.735228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:15.736800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:15.737252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:16.047239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:16.055960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9aa87c48-a759-4e8e-b5bd-a206614697d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.332178 Aug 03 09:56:16.056538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1159/2428] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:16.197131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:16.198341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:16.204962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:16.205413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:16.206173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:16.206608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:16.335887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:16.343703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d63cb7a-6783-4332-8c77-6ae4be212ca2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150522 Aug 03 09:56:16.344509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1270/2429] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:16 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:17.077915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:17.078498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:17.085167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:17.085607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:17.086355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:17.086783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:17.148319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:17.156224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa78c215-8a66-4a27-b8d9-fa4923715a10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082187 Aug 03 09:56:17.156773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1160/2430] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:17.364976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:17.365584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:17.372122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:17.372562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:17.373342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:17.373773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:17.505546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:17.513470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f720346d-fd1c-4e6d-8df8-6ffd01933fa2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152978 Aug 03 09:56:17.514039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1271/2431] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:18.177856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:18.178464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:18.185029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:18.185469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:18.186208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:18.186630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:18.250214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:18.258121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f8816bb-679f-4f28-a194-847bea2ae790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084176 Aug 03 09:56:18.258687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1161/2432] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:18.535457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:18.536064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:18.542547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:18.543042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:18.543789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:18.544216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:18.672443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:18.681197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5b7c561e-61b6-4aa9-b0c9-3bc39a074170 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150203 Aug 03 09:56:18.681763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1272/2433] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:18 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:19.279141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:19.279752 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:19.286861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:19.287308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:19.288062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:19.288494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:19.349524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:19.357518 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-91189305-5799-453b-9d12-da80c75c5278 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082254 Aug 03 09:56:19.358079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1162/2434] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:19.702951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:19.703559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:19.710033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:19.710476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:19.711217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:19.711642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:19.839729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:19.848096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-57aadf3c-1d42-4749-8c1b-b39fcf3ba4a1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149055 Aug 03 09:56:19.848658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1273/2435] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:20.378951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:20.379557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:20.386055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:20.386498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:20.387249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:20.387676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:20.452126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:20.460796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-54fb5261-d1c1-465a-884a-d96be7bdf898 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086487 Aug 03 09:56:20.461387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1163/2436] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:20.869237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:20.869913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:20.876368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:20.876939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:20.877682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:20.878113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:21.012556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:21.020497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e5b5054-d264-4a4a-9f37-bd827599f004 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155124 Aug 03 09:56:21.021074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1274/2437] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:21.482203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:21.482811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:21.489857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:21.490301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:21.491056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:21.491485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:21.552692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:21.560574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-85606306-f5b2-4fb7-9ccc-06324b35807f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082273 Aug 03 09:56:21.561168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1164/2438] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:22.041002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:22.041611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:22.048181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:22.048784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:22.049566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:22.050003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:22.177333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:22.185199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90b2335e-c5fd-4e40-aba4-05fba6fbf1c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148001 Aug 03 09:56:22.185771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1275/2439] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:22 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:22.582673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:22.583275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:22.589757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:22.590197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:22.590958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:22.591376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:22.653499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:22.655658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:22.662667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9a089b3-f843-4124-8cc2-ed9c4e71c322 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084509 Aug 03 09:56:22.663228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1165/2440] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:23.206531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:23.207812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:23.214421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.214873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.215632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.216063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.349764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:23.357837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6a5d0fe4-e9fb-4daf-9ce8-5d55e96011b7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155152 Aug 03 09:56:23.358404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1276/2441] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:23 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:23.683657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:23.684247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:23.691084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.691522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.692267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.692695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.752585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:23.760426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a9bce6e-9778-4392-b200-f3c247caa36e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080785 Aug 03 09:56:23.761032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1166/2442] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:23.903289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:23.903776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:23.911037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.911554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.912326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:23.912758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:23.935858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c70dc45d-f344-4b7f-b6f1-e447446be414 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2/ips" status: 200 len: 151 microversion: 2.20 time: 0.036383 Aug 03 09:56:23.936350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1277/2443] 10.222.0.20 () {60 vars in 1289 bytes} [Wed Aug 3 09:56:23 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 03 09:56:24.378353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:24.378962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:24.385064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:24.385512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:24.386265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:24.386696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:24.516241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:24.524798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ff85c509-1189-4184-8b48-07646566d816 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150377 Aug 03 09:56:24.525385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1167/2444] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:24.781360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:24.781982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:24.788560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:24.789049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:24.789805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:24.790243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:24.853395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:24.861440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e337dd48-a474-4803-afef-24db1e617983 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083923 Aug 03 09:56:24.862003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1278/2445] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:25.545452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:25.546059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:25.553393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:25.553832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:25.554576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:25.555001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:25.684007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:25.691930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3d1032c9-ccb5-43d3-9957-ea8b0939aae0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150367 Aug 03 09:56:25.692487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1168/2446] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:25 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:25.882276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:25.882819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:25.889269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:25.889720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:25.890474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:25.890912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:25.952545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:25.961004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b2f76e78-ce5c-441d-8adc-39e6ad9be46e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082597 Aug 03 09:56:25.961563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1279/2447] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:26.712913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:26.713527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:26.720289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:26.720735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:26.721527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:26.721963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:26.851143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:26.859047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0fb8e83d-58d6-4817-b2ea-3d150056e36e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150038 Aug 03 09:56:26.859612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1169/2448] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:26.982216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:26.982758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:26.989973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:26.990428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:26.991184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:26.991621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:27.053908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:27.061943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-19da9997-7123-4065-bd58-5d0873c2dc2d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083651 Aug 03 09:56:27.062500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1280/2449] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:27.880905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:27.881517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:27.887988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:27.888430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:27.889216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:27.889651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:28.016260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:28.024590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5221dc7b-5c1e-4272-b0d6-ae115de009dd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147615 Aug 03 09:56:28.025186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1170/2450] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:28.083582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:28.084172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:28.090685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:28.091126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:28.091873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:28.092301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:28.107408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:28.156204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:28.164838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-40cd2650-7ca8-4103-9556-27e8260a4c06 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085796 Aug 03 09:56:28.165406 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1281/2451] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:29.046415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:29.047028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:29.054594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:29.055435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:29.055824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:29.056264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:29.185275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:29.186002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:29.190354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:29.192352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:29.192805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:29.193601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:29.194043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:29.198519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d34684b4-557c-40f7-ac1d-19e5dacfebf6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155781 Aug 03 09:56:29.199096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1171/2452] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:29 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:29.256366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:29.264316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45d6b47d-ff3a-47cd-8557-b9e37cb616a2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082893 Aug 03 09:56:29.264903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1282/2453] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:30.218793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:30.219406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:30.226150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:30.226590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:30.227362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:30.227788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:30.285009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:30.285621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:30.292933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:30.293391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:30.294161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:30.294600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:30.359357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:30.367968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62c2cf08-83a2-4999-a96c-6c418fd693c9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086774 Aug 03 09:56:30.368536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1283/2454] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:30.429194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:30.437071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cb83606a-f765-445d-bdc7-78ed068df42b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.222236 Aug 03 09:56:30.437641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1172/2455] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:30 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:31.502428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:31.503627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:31.509726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:31.510162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:31.510914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:31.511348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:31.574165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:31.581822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:31.582437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:31.586753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fba6035d-31b3-470a-8379-32cb2993bf6f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.201482 Aug 03 09:56:31.587332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1284/2456] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:31.588756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:31.589234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:31.590023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:31.590449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:31.717217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:31.725627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0814fc2d-8f96-4c31-bd0f-13652e4f8751 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.269240 Aug 03 09:56:31.726186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1173/2457] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:31 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:32.607789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:32.608383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:32.615409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:32.615849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:32.616592 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:32.617046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:32.680704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:32.689253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-323c48e3-18db-4e9d-b4c0-51da62270fe5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084701 Aug 03 09:56:32.689829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1285/2458] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:32.746602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:32.747218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:32.749692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=54 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:32.756204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:32.756669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:32.757465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:32.757895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:32.888597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:32.897173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b3fb224-743a-4c85-8d2c-915f9de616a2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154503 Aug 03 09:56:32.897735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1174/2459] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:33.710448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:33.710985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:33.713298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=54 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:33.718735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:33.719183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:33.720726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:33.721201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:33.784989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:33.792871 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-090b34c0-13cb-4c54-8cb4-9649501f293c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086393 Aug 03 09:56:33.793430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1286/2460] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:33.918099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:33.918704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:33.925370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:33.925811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:33.926557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:33.926982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:34.052449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:34.060893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2ed22808-ce0a-467c-a95a-7e2e90183f08 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146717 Aug 03 09:56:34.061459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1175/2461] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:34.814197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:34.815469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:34.822009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:34.822451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:34.823199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:34.823882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:34.883679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:34.891563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-84f23b52-c9c2-43cc-b34a-6d5cafe538dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081271 Aug 03 09:56:34.892308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1287/2462] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:35.082183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:35.082746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:35.089322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:35.089764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:35.090504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:35.090930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:35.228246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:35.238017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7bb1c7a6-8464-4100-97e0-aaedc7fbf793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.159817 Aug 03 09:56:35.238586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1176/2463] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:35 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:35.912365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:35.913002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:35.919486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:35.919927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:35.920673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:35.921122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:35.982816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:35.990919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b0649089-968c-47f8-a66a-d7787a2e8ee8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083268 Aug 03 09:56:35.991506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1288/2464] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:36.259357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:36.259880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:36.266895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:36.267336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:36.268076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:36.268502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:36.398181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:36.406102 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5b08f67d-84be-44aa-ab8f-0f9734c7df18 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150665 Aug 03 09:56:36.406668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1177/2465] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:37.012052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:37.012661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:37.019851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:37.020293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:37.021076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:37.021503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:37.085842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:37.093632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c7d74827-de98-4172-986a-58d883c800ac tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085415 Aug 03 09:56:37.094189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1289/2466] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:37.427704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:37.428317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:37.434902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:37.435352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:37.436109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:37.436544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:37.566417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:37.574602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a69ed8d9-1244-4e82-aca6-b010821d2b4a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150779 Aug 03 09:56:37.575159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1178/2467] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:38.115664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:38.116274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:38.123134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:38.123610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:38.124364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:38.124798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:38.187143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:38.195250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a0d265a-8894-4869-9b6e-fadc17f101cf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083791 Aug 03 09:56:38.195817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1290/2468] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:38.596309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:38.596892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:38.603286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:38.603724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:38.604465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:38.604916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:38.734449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:38.742474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b493722f-c88e-4d84-8656-70bea6ccd3d9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150839 Aug 03 09:56:38.743062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1179/2469] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:39.215578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:39.216187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:39.223358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:39.223799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:39.224539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:39.224999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:39.285593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:39.293433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a7725083-9e46-457e-a8a7-c7cff39b6310 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081705 Aug 03 09:56:39.293993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1291/2470] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:39.763508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:39.764063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:39.770712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:39.771160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:39.771910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:39.772345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:39.900146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:39.908999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-33245e8b-d2f7-4aaa-8e56-7fc2a4769533 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149339 Aug 03 09:56:39.909593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1180/2471] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:40.313821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:40.314447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:40.320926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:40.321370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:40.322124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:40.322553 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:40.383632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:40.392097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dbd9c476-b079-43c5-9b55-d3c838964375 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082130 Aug 03 09:56:40.392700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1292/2472] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:40.930794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:40.931395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:40.937807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:40.938245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:40.939023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:40.939447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:41.071852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:41.080652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f8f773cf-4c18-4d41-b6e7-e28557601672 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153067 Aug 03 09:56:41.081358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1181/2473] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:41.413531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:41.414154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:41.420523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:41.421010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:41.421757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:41.422185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:41.487426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:41.495362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df8ea435-c85d-42c0-b0c3-15130a032933 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085642 Aug 03 09:56:41.495926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1293/2474] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:42.101885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:42.102493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:42.108962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:42.109412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:42.110166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:42.110599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:42.126294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:42.239805 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:42.247645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e9ea377-9554-4079-8817-6eb79197c940 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149613 Aug 03 09:56:42.248203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1182/2475] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:42 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:42.515845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:42.516451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:42.522949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:42.523397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:42.524144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:42.524571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:42.585888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:42.593715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7046d70-43d2-4f67-a76f-f075e7edbebc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081697 Aug 03 09:56:42.594284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1294/2476] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:43.270288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:43.270895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:43.277438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:43.277878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:43.278623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:43.279048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:43.411113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:43.419015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9df8db6d-9e90-43d5-a8b3-d04d8e16fb4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153890 Aug 03 09:56:43.419574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1183/2477] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:43.615646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:43.616173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:43.622555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:43.622997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:43.623746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:43.624178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:43.684414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:43.692357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb529e2d-329b-4d31-9002-89c37e67c441 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081380 Aug 03 09:56:43.692939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1295/2478] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:44.440722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:44.441976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:44.449734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:44.450179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:44.450947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:44.451378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:44.598427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:44.607368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6da71ea3-5d16-4811-ba33-5acc36ac7d1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.170550 Aug 03 09:56:44.607938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1184/2479] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:44.713548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:44.714072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:44.720935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:44.721390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:44.722138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:44.722600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:44.783172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:44.791044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fb3bfac6-e395-47d8-b14e-5fd3fff5a78f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081444 Aug 03 09:56:44.791623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1296/2480] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:45.630059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:45.630574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:45.637130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:45.637578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:45.638332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:45.638768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:45.767283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:45.775401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-787d746e-9805-44f2-a52b-7c73847a9b7a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149301 Aug 03 09:56:45.775967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1185/2481] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:45.811512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:45.812130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:45.818849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:45.819301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:45.820067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:45.820500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:45.885726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:45.894299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dbc24f0d-2ec9-4a07-93ba-c810bc10a8a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086618 Aug 03 09:56:45.894868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1297/2482] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:46.796869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:46.797426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:46.804391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:46.804854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:46.805601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:46.806028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:46.915644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:46.916367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:46.922593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:46.923133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:46.924495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:46.925040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:46.929078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:56:46.934912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:46.944024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f1f1c9d5-038e-46fe-9a4d-ec2f8bed0248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151072 Aug 03 09:56:46.944601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1186/2483] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:46.987518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:46.995393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-33afe8e3-8453-46ab-bccf-cce933b5f45a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084244 Aug 03 09:56:46.995958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1298/2484] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:47.965016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:47.965621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:47.972460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:47.972936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:47.973697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:47.974158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:48.016695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:48.018664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:48.025126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:48.025576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:48.026334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:48.026765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:48.090822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:48.098920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c21fef94-23cf-464d-92f1-e0e4096d8583 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086007 Aug 03 09:56:48.099501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1299/2485] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:48.103657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:48.111989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-27e604a7-b176-42dd-8159-d56cf4fb13e1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150849 Aug 03 09:56:48.112540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1187/2486] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:49.120666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:49.121305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:49.129152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:49.129607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:49.130365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:49.130800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:49.132739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:49.133571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:49.139875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:49.140314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:49.141095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:49.141525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:49.195459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:49.205377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c28955b-f597-4116-a4b4-5c35153ddec3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088292 Aug 03 09:56:49.205962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1300/2487] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:49.279647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:49.288661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ea399fbc-b6b0-4680-ae13-ad06a2af55a3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.160025 Aug 03 09:56:49.289247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1188/2488] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:49 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:50.226837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:50.227444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:50.233887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:50.234323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:50.235065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:50.235491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:50.300178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:50.308462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-49ca1077-3f2e-432a-a848-4d8b12339911 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085355 Aug 03 09:56:50.308986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1301/2489] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:50.309904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:50.310508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:50.317838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:50.318277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:50.319020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:50.319442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:50.447923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:50.456121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8bd304f5-fcbf-45e2-804d-6902b443550a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150096 Aug 03 09:56:50.456684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1189/2490] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:56:51.330828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:51.331382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:51.337826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:51.338266 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:51.339012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:51.339438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:51.404317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:51.413475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af1c0915-72f2-49da-8aff-c22826ec7f99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087308 Aug 03 09:56:51.414027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1302/2491] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:51.477513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:51.478119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:51.484598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:51.485077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:51.485953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:51.486968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:51.617324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:51.625146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a5c2593-ac25-4b9d-9836-33f24df661e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151417 Aug 03 09:56:51.625703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1190/2492] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:52.434564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:52.435265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:52.442736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:52.443259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:52.444105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:52.444615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:52.508308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:52.516218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2722ec8-6797-43a7-b40a-be45a190e687 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085535 Aug 03 09:56:52.516777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1303/2493] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:52.647040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:52.647645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:52.654354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:52.654794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:52.655537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:52.655961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:52.850773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:52.858641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bb3ad351-1af9-41af-8d8a-36c2ea9902dc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.215484 Aug 03 09:56:52.859202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1191/2494] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:53.537989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:53.538594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:53.545110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:53.545556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:53.546301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:53.546729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:53.607729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:53.615696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea662371-2f4b-40b1-9c19-b7c94bdcdbbf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081454 Aug 03 09:56:53.616189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1304/2495] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:53.880278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:53.880915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:53.887374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:53.887818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:53.888572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:53.889049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:54.026097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:54.033965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c016f16-4723-4b8c-92db-b952de488442 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158158 Aug 03 09:56:54.034553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1192/2496] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:54.636175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:54.636858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:54.643319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:54.643758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:54.644500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:54.644956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:54.708464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:54.716238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ef48472-a9d6-48f9-b004-176ff3a1f90b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083901 Aug 03 09:56:54.716795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1305/2497] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:55.054719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:55.055740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:55.061770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:55.062204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:55.062983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:55.063411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:55.191199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:55.199315 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa2e200c-4876-4cb5-b8eb-ea89210d2eb1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148238 Aug 03 09:56:55.199888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1193/2498] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:55 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:55.738954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:55.739560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:55.746175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:55.746621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:55.747390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:55.747817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:55.810770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:55.819528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e1c4f649-043c-4eee-9b4d-3dc9b0f72bf0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085078 Aug 03 09:56:55.820084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1306/2499] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:56.222597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:56.223200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:56.229641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:56.230090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:56.230837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:56.231264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:56.358608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:56.367173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3c5a0975-73e8-43ef-9e38-96d64a7bbee4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148974 Aug 03 09:56:56.367747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1194/2500] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:56.840244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:56.840855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:56.847744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:56.848189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:56.848968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:56.849403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:56.910282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:56.918213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a5211eb-7f5b-41c3-b0f9-c247ad483047 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081814 Aug 03 09:56:56.918772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1307/2501] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:57.388028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:57.388640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:57.395840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:57.396278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:57.397089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:57.397535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:57.527295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:57.535192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ef3ed44-e356-462c-87b6-0ea110e35f4f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151114 Aug 03 09:56:57.535750 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1195/2502] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:57.939582 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:57.940338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:57.946836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:57.947275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:57.948018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:57.948443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:58.009242 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:58.017682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bea9acc7-a42a-4666-901a-318f828fb16f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082000 Aug 03 09:56:58.018558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1308/2503] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:58.555436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:58.556032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:58.562509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:58.562944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:58.563683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:58.564645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:58.692301 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:58.700452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a4681ab-1b38-4ed9-a5f1-3b1b84d43c52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148869 Aug 03 09:56:58.701040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1196/2504] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:59.039194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:59.039798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:59.046605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:59.047085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:59.047847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:59.049095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:59.112796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:59.121006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ef3d474-ff79-4c60-9780-e73ec6c6391a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085578 Aug 03 09:56:59.121561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1309/2505] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:56:59.721800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:56:59.722336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:56:59.728765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:59.729235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:59.729983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:56:59.730409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:56:59.864063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:56:59.871967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4f0b9f4c-4352-4f77-bc42-c84ede3aecd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154109 Aug 03 09:56:59.872525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1197/2506] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:56:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:00.141651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:00.142338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:00.149488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:00.149936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:00.150684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:00.151117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:00.212272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:00.220187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0ce5231-b7f4-4c2f-9512-29867f24900a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082387 Aug 03 09:57:00.221106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1310/2507] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:00.894920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:00.895528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:00.902155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:00.902602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:00.903353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:00.903786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:01.035488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:01.043314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-db3a84ae-1192-4c69-aaa1-836925069c46 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153411 Aug 03 09:57:01.043875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1198/2508] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:01.241541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:01.242069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:01.248510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:01.248994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:01.249737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:01.250165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:01.310168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:01.318505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f046d7a-d201-46da-ab75-8a0c9369ee3b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081097 Aug 03 09:57:01.319067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1311/2509] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:02.063578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:02.064192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:02.070744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:02.071195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:02.071953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:02.072388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:02.076690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:02.198855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:02.207041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fc2b41b6-ccd5-42c4-bcdc-2c98ea8c29c8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147420 Aug 03 09:57:02.207608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1199/2510] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:02 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:02.339395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:02.339965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:02.346404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:02.347829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:02.348707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:02.349175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:02.411562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:02.419608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2228acbd-d339-4e70-98e8-4685faf08f93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084098 Aug 03 09:57:02.420206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1312/2511] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:03.227579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:03.229134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:03.232743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=52 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:03.236568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:03.237035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:03.238592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:03.239041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:03.371598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:03.380254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6de48282-401a-4f82-863b-9c75fca7e6b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156540 Aug 03 09:57:03.380848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1200/2512] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:03.440232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:03.441858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:03.448310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:03.448752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:03.449807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:03.450239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:03.516634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:03.525622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-310320bc-7dda-4af8-bd7a-6cbe38e509ee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.089195 Aug 03 09:57:03.526182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1313/2513] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:04.401037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:04.401649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:04.408247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:04.408694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:04.409996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:04.410430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:04.537343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:04.545357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5c215da-64e3-49e3-a2ef-5635e7cb10b5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148217 Aug 03 09:57:04.545917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1201/2514] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:04 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:04.546455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:04.547248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:04.549738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=56 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:04.555888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:04.556338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:04.557117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:04.557554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:04.619601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:04.621751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:04.629250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ded5c232-2d40-4772-9267-3229f64fafca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086542 Aug 03 09:57:04.629818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1314/2515] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:05.566475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:05.567112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:05.573575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:05.574019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:05.575028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:05.575453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:05.650196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:05.650754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:05.657414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:05.657855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:05.658606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:05.659036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:05.711902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:05.720435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-299acbf7-eebc-4320-a15d-29b8b365c40e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158230 Aug 03 09:57:05.720792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1202/2516] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:05.723240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:05.731210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a7d2e1dd-f112-4bb9-b210-b85fb77b8eba tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084999 Aug 03 09:57:05.731910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1315/2517] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:06.741073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:06.741679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:06.748108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:06.748550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:06.749327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:06.749756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:06.753718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:06.754413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:06.760962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:06.761414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:06.762226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:06.762664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:06.825555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:06.834531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e84c6221-8cfc-4bcc-990e-f665bc242ce6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085104 Aug 03 09:57:06.835051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1316/2518] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:06.879758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:06.887712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d6f94c0a-a330-4a2a-87c4-5795c146cc4c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150568 Aug 03 09:57:06.888295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1203/2519] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:07.855146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:07.855779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:07.862843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:07.863735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:07.864492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:07.864961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:07.908533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:07.909202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:07.916181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:07.916624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:07.917420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:07.917876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:07.930277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:07.938326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cacac865-4370-4eec-a4a8-699105c59f7a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087020 Aug 03 09:57:07.938880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1317/2520] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:08.057429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:08.065942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-977aed1a-a9cb-4e79-a74a-1c7c835e01ed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.160767 Aug 03 09:57:08.066517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1204/2521] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:07 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:08.960445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:08.961084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:08.967634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:08.968084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:08.968863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:08.969308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:09.030102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:09.038810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df3d1aa7-8739-4c6c-8c6b-e84fc49c1dcd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082407 Aug 03 09:57:09.039381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1318/2522] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:09.087028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:09.087635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:09.094118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:09.094557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:09.095300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:09.095726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:09.226512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:09.234413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e3d98aaf-2dbb-4408-804e-ccec5ce71d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151244 Aug 03 09:57:09.234970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1205/2523] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:09 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:10.059585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:10.060201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:10.067190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:10.067643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:10.068403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:10.068861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:10.132492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:10.140503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45b468ff-9658-431d-9b86-e1e73379c2e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084859 Aug 03 09:57:10.141117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1319/2524] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:10.255939 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:10.256570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:10.263071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:10.263510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:10.264256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:10.264681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:10.390401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:10.398987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c115116-9d64-4704-b673-9413100bed91 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147548 Aug 03 09:57:10.399553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1206/2525] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:11.163628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:11.164234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:11.170787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:11.171225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:11.171967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:11.172639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:11.233455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:11.241808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b40a2db1-39db-49cc-8ddd-8333f0775d81 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082172 Aug 03 09:57:11.242372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1320/2526] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:11.419883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:11.420502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:11.427619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:11.428067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:11.428841 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:11.429282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:11.559129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:11.567748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3030621a-91e6-466b-b7d5-a29b823a4e66 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151111 Aug 03 09:57:11.568324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1207/2527] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:11 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:12.263210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:12.263822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:12.271431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:12.271885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:12.272646 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:12.273113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:12.337536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:12.345427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6d5fb126-758a-44da-8ac9-866a08482e74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086127 Aug 03 09:57:12.345991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1321/2528] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:12.588916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:12.589496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:12.595908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:12.596354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:12.597143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:12.597575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:12.725440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:12.733367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2cc9669d-f033-413b-bb15-df4fcdfe5be4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148403 Aug 03 09:57:12.733924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1208/2529] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:13.367559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:13.368182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:13.374762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:13.375187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:13.375922 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:13.376377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:13.437659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:13.446011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-93a7ead2-c518-4022-abfb-ac269ae87408 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083855 Aug 03 09:57:13.446574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1322/2530] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:13.755215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:13.755723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:13.762305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:13.762764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:13.763512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:13.763934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:13.894963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:13.902888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e040291-0f8e-49ae-bb0e-9980dc0521b4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151683 Aug 03 09:57:13.903454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1209/2531] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:14.468279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:14.468906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:14.474999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:14.475438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:14.476182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:14.476613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:14.537148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:14.544926 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-46cd40a8-53f5-4427-a535-70e93d3384a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080673 Aug 03 09:57:14.545514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1323/2532] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:14.924284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:14.924915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:14.932241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:14.932678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:14.933465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:14.933891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:15.060535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:15.068423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-43625752-97a3-4169-80ca-12db7a01ccce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147969 Aug 03 09:57:15.069006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1210/2533] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:14 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:15.566089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:15.567234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:15.573925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:15.574370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:15.575371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:15.575804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:15.637293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:15.645736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a21705b7-b9a7-47f8-95df-3932e1f30b6b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082860 Aug 03 09:57:15.646262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1324/2534] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:16.089547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:16.090157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:16.096663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:16.097135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:16.097889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:16.098669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:16.228105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:16.236085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-da321a6d-1e84-4910-b9e9-52d51d66d054 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150372 Aug 03 09:57:16.236650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1211/2535] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:16 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:16.666828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:16.667437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:16.673929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:16.674368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:16.675112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:16.675537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:16.739999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:16.747900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-575084f9-3b20-4de9-a7e3-7e5644819281 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084903 Aug 03 09:57:16.748463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1325/2536] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:17.257971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:17.258587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:17.265082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:17.265529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:17.266290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:17.266723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:17.398645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:17.406672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a3cf5f6-2248-4a08-ae86-b333832ff7f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153186 Aug 03 09:57:17.407233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1212/2537] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:17.768711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:17.769368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:17.775825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:17.776268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:17.777047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:17.777506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:17.843371 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:17.851845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-368414d4-b0ef-4825-a29d-f82df7523544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086950 Aug 03 09:57:17.852405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1326/2538] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:18.428265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:18.428894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:18.435367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:18.435802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:18.436547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:18.437009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:18.563494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:18.572093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f911b99-aca5-49a2-b6a7-15c92708b828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147797 Aug 03 09:57:18.572603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1213/2539] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:18 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:18.871975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:18.872615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:18.879065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:18.880255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:18.881212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:18.881648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:18.942567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:18.950939 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-943aad88-77cf-4d7d-8158-53308f1b77fa tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082743 Aug 03 09:57:18.951493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1327/2540] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:19.593786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:19.594404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:19.601003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:19.601453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:19.602207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:19.602640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:19.732711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:19.741221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5f82520-b794-4dec-bb4b-25f412d1463f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151280 Aug 03 09:57:19.741795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1214/2541] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:19.971562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:19.972102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:19.979177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:19.979616 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:19.980360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:19.980789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:20.041279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:20.049054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-149f7aab-7af4-42e5-8b7a-df112c85e3b1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081400 Aug 03 09:57:20.049619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1328/2542] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:20.763393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:20.764030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:20.770961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:20.771398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:20.772146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:20.772570 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:20.898730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:20.900967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:20.907621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cbf2e8f5-ae3d-4459-9206-e4ff00420881 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148256 Aug 03 09:57:20.908185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1215/2543] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:21.070590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:21.071220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:21.077911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:21.078352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:21.079097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:21.079593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:21.143330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:21.151726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9d64fcc8-b3b0-4a85-b76c-d97450d6d194 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085217 Aug 03 09:57:21.152280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1329/2544] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:21.929564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:21.930174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:21.936742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:21.937215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:21.937967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:21.938397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:22.067141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:22.075515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5731de0c-e583-4742-a72f-a79508fe1a30 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149875 Aug 03 09:57:22.076068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1216/2545] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:21 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:22.172837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:22.173583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:22.180189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:22.180569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:22.181439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:22.181866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:22.243808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:22.251764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9afc42d6-5e75-47f1-b6ef-3100daf64b99 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082784 Aug 03 09:57:22.252319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1330/2546] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:23.096728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:23.097373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:23.104608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:23.105089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:23.105851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:23.106286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:23.233515 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:23.242222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bad84261-44e3-4071-8454-3d54e57b1554 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149284 Aug 03 09:57:23.242794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1217/2547] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:23 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:23.272702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:23.273349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:23.279872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:23.280312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:23.281083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:23.281510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:23.296615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:23.343326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:23.352030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0f3bcb4-a3cb-4abe-8335-3bd45f2c7f9b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083236 Aug 03 09:57:23.352606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1331/2548] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:23.518792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:57:23.518975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:57:24.010639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:24.011124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:24.017150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.017590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.018328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.018754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.046090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:57:24.124062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4615bfc3-0973-4563-b5c6-32bed7066667 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 204 len: 0 microversion: 2.20 time: 0.116975 Aug 03 09:57:24.125046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1218/2549] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 3 09:57:24 2022] DELETE /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 09:57:24.137324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:24.137936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:24.143979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.144419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.145264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.145698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.264180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:24.265200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:24.271407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.271855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.272626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.273087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:24.273560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.281164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:24.282688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:24.283825 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f852ba44-3a00-4c09-87b4-d57f628df732 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1720 microversion: 2.20 time: 0.154844 Aug 03 09:57:24.284381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1332/2550] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:57:24 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:57:24.372315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:24.372959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:24.378990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.380108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.380980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:24.381427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:24.403432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:24.411892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5b78be2b-e909-45ee-b342-99ede91a148e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152137 Aug 03 09:57:24.412456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1219/2551] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:24.449104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:24.457204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3b9a9cc0-c873-4583-a3ea-64f2b31ec947 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088671 Aug 03 09:57:24.457795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1333/2552] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:25.308169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:25.308705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:25.315239 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.315682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.316431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.317770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.432793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:25.433438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:25.439838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.440277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.441066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.441496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.451986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:25.460319 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:25.461834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:25.462975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0a29f803-ec4e-44c3-9473-64ba7a66160d tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1720 microversion: 2.20 time: 0.158892 Aug 03 09:57:25.463525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1220/2553] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:57:25 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:57:25.477364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:25.478164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:25.484451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.484925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.485685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:25.486111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:25.557696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:25.566033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8eae3eeb-ee2e-4117-b725-3466e1df052a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.092186 Aug 03 09:57:25.566543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1221/2554] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:25.576558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:25.585271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eaf5eb85-7cb3-4803-8263-887cc2993e28 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156271 Aug 03 09:57:25.585828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1334/2555] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:25 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:26.419993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-60726d7f-5f8a-4b9b-aa77-0e2bfa7fa907 req-a40219e4-bef6-422e-aa77-942d143ddc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b58105a-872a-493e-b343-a257e90d24b2", "name": "network-vif-deleted", "tag": "6bd32305-82b6-4ada-8bcf-6d32288ef6ac"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 09:57:26.433963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-60726d7f-5f8a-4b9b-aa77-0e2bfa7fa907 req-a40219e4-bef6-422e-aa77-942d143ddc02 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.434549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-60726d7f-5f8a-4b9b-aa77-0e2bfa7fa907 req-a40219e4-bef6-422e-aa77-942d143ddc02 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.446678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-60726d7f-5f8a-4b9b-aa77-0e2bfa7fa907 req-a40219e4-bef6-422e-aa77-942d143ddc02 service nova] Creating event network-vif-deleted:6bd32305-82b6-4ada-8bcf-6d32288ef6ac for instance 3b58105a-872a-493e-b343-a257e90d24b2 on hv-cinder-84456 Aug 03 09:57:26.451778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-60726d7f-5f8a-4b9b-aa77-0e2bfa7fa907 req-a40219e4-bef6-422e-aa77-942d143ddc02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035456 Aug 03 09:57:26.452459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1222/2556] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 09:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 09:57:26.487502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:26.488222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:26.496168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.496715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.497581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.498089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.543763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.544216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.544679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lazy-loading 'fault' on Instance uuid 3b58105a-872a-493e-b343-a257e90d24b2 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 09:57:26.587932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:26.589265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:26.593091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:26.599669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.600449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.601902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.602583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.604189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:26.605817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:26.607250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7f0e9b0c-aef0-4247-a961-adda7a9c76ce tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 200 len: 1369 microversion: 2.20 time: 0.124572 Aug 03 09:57:26.609044 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1335/2557] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:57:26 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 1369 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 09:57:26.618228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:26.621323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:26.632776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.633255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.634042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:26.634480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:26.685691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:26.699857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7a276888-b68f-46f4-9047-dfc0780f8b65 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.117397 Aug 03 09:57:26.701343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1223/2558] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:26.787134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:26.795792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d49c9534-ad78-4cd7-98a8-2f6fa576d76a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.184261 Aug 03 09:57:26.796581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1336/2559] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:27.632082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:27.632616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:27.639124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.639567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.640309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.640739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.654586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] HTTP exception thrown: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Request method failure captured: Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 HTTP/1.1 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA2xIHaKSHD3I5A5Nj7K2Bni6qDT3xpNxynvrpAqw4swoBgJ2IWR6cDtxWcVmZbb21vF0cF9W8eEOO18wzDZUlS_pt8H1lAknJ6UDe7XnutQjLQZZMA_tyxWvl7OTFDQtlEsyw4EPy8EKpHQduSXeqtbtfkMyXnrTymAWZT7lxgG0Y Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:57:27.656233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a4f922101d8435d977a4df9843338e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}] Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 317467d6f856435f8f7eee33eb92c6e3 Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:27.658099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '3b58105a-872a-493e-b343-a257e90d24b2'} Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:57:27.659295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:27.661068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:27.662580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Returning 404 to user: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:57:27.662580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c35c5f65-4614-4a5b-93ae-96137ff21eb8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 404 len: 111 microversion: 2.20 time: 0.030341 Aug 03 09:57:27.662580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1224/2560] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:57:27 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:57:27.666481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4a013657-f4b5-426f-af50-ff30b161718c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '.version_select at 0x7fb99d47c4c0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:27.684785 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4a013657-f4b5-426f-af50-ff30b161718c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99883284" status: 204 len: 0 microversion: 2.20 time: 0.022003 Aug 03 09:57:27.685362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1337/2561] 10.222.0.20 () {60 vars in 1256 bytes} [Wed Aug 3 09:57:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99883284 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 09:57:27.721236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:27.721946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:27.728407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.728862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.729636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.730069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.796522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:27.805827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01230fd2-c813-4404-8851-4e265df83d2e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088401 Aug 03 09:57:27.806485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1225/2562] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:27.825984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:27.826635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:27.834113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.834561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.835330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:27.835765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:27.977083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:27.985566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72da74a8-132e-48aa-bd4b-a86b6775e040 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.163746 Aug 03 09:57:27.986132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1338/2563] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:28.295494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:28.295991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:28.302005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.302457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.303205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.303640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.317351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] HTTP exception thrown: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Request method failure captured: Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 HTTP/1.1 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kA2xIHaKSHD3I5A5Nj7K2Bni6qDT3xpNxynvrpAqw4swoBgJ2IWR6cDtxWcVmZbb21vF0cF9W8eEOO18wzDZUlS_pt8H1lAknJ6UDe7XnutQjLQZZMA_tyxWvl7OTFDQtlEsyw4EPy8EKpHQduSXeqtbtfkMyXnrTymAWZT7lxgG0Y Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 09:57:28.318917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a4f922101d8435d977a4df9843338e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}] Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 317467d6f856435f8f7eee33eb92c6e3 Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.320656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '3b58105a-872a-493e-b343-a257e90d24b2'} Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:57:28.321651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.323238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.324799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Returning 404 to user: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:57:28.324799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-613bf630-a6a4-4e0b-9e40-2e66e77f5980 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 404 len: 111 microversion: 2.20 time: 0.028743 Aug 03 09:57:28.324799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1226/2564] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 3 09:57:28 2022] DELETE /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:57:28.328998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:28.329617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: 3b58105a-872a-493e-b343-a257e90d24b2] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:28.336235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.336683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.337484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.337918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.351148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] HTTP exception thrown: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Request method failure captured: Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 HTTP/1.1 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA2xIHaKSHD3I5A5Nj7K2Bni6qDT3xpNxynvrpAqw4swoBgJ2IWR6cDtxWcVmZbb21vF0cF9W8eEOO18wzDZUlS_pt8H1lAknJ6UDe7XnutQjLQZZMA_tyxWvl7OTFDQtlEsyw4EPy8EKpHQduSXeqtbtfkMyXnrTymAWZT7lxgG0Y Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 09:57:28.352781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a4f922101d8435d977a4df9843338e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}] Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 317467d6f856435f8f7eee33eb92c6e3 Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.354551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '3b58105a-872a-493e-b343-a257e90d24b2'} Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 09:57:28.355518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. Aug 03 09:57:28.357128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 09:57:28.358518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Returning 404 to user: Instance 3b58105a-872a-493e-b343-a257e90d24b2 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 09:57:28.358518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ea8b4466-167c-4b21-9dca-ba0f96072b92 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2" status: 404 len: 111 microversion: 2.20 time: 0.029344 Aug 03 09:57:28.358518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1339/2565] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 09:57:28 2022] GET /compute/v2.1/servers/3b58105a-872a-493e-b343-a257e90d24b2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 09:57:28.827895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:28.828429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:28.835582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.836030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.836788 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:28.837264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:28.899384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:28.907313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-40aba6e9-50cd-42bd-8047-efe76f1836c4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083642 Aug 03 09:57:28.907873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1227/2566] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:29.007651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:29.008253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:29.014676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:29.015120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:29.015863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:29.016290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:29.143995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:29.152434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-be405cda-0b92-4102-83ac-73fc4f7e6e52 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149396 Aug 03 09:57:29.153016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1340/2567] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:29 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:29.930073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:29.930679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:29.937216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:29.937660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:29.938412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:29.938870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:30.001583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:30.009479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3686cf91-2298-4d13-b1da-f49ab309d499 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084129 Aug 03 09:57:30.010038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1228/2568] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:30.172245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:30.172885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:30.179541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:30.179985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:30.180788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:30.181200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:30.312762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:30.320833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-edc3fca5-d2e7-489d-be6d-8d9fec5a0e82 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152440 Aug 03 09:57:30.321416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1341/2569] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:30 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:31.031621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:31.032386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:31.038991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:31.039438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:31.040186 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:31.040618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:31.102228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:31.110436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c7cd27e-daf6-4368-b4f8-902547d83fd5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083572 Aug 03 09:57:31.111086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1229/2570] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:31.342576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:31.343106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:31.350025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:31.350466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:31.351209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:31.351633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:31.482583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:31.491226 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01c9ee57-35ec-4a1f-b767-2cbcbf6ee788 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152576 Aug 03 09:57:31.491788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1342/2571] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:31 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:32.132415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:32.133057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:32.139661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:32.140098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:32.140864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:32.141288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:32.205149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:32.213643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b43e3a08-eb39-4696-a90c-2952b9901424 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085799 Aug 03 09:57:32.214199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1230/2572] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:32.511398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:32.511999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:32.518511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:32.518960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:32.519703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:32.520220 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:32.645609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:32.653424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bebcb36a-dbac-4ca2-8d07-8ea7f76574d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.145844 Aug 03 09:57:32.653977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1343/2573] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:33.233826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:33.234492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:33.241888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:33.242328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:33.243081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:33.243512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:33.305497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:33.313214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-29fcdf44-190c-4017-805a-24a9b3beadbc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083366 Aug 03 09:57:33.313771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1231/2574] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:33.674797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:33.675435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:33.682680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:33.683123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:33.683873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:33.684307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:33.817228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:33.825135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd8bdecb-0ed2-47b1-bcc8-dddddb258d62 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154131 Aug 03 09:57:33.825965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1344/2575] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:34.335482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:34.336020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:34.338446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:34.343856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:34.344298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:34.345075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:34.345502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:34.408182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:34.410806 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:34.418504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-44646536-6b67-41a9-9822-381f970c7bad tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087704 Aug 03 09:57:34.419106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1232/2576] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:34.847276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:34.847918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:34.850270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:34.856203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:34.856649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:34.857434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:34.857898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:34.986597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:34.994962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5a13fac5-e611-4a36-b818-9bb4d3fbe6f9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151574 Aug 03 09:57:34.995523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1345/2577] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:34 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:35.440084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:35.440713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:35.449490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:35.449935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:35.450954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:35.451387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:35.512745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:35.520665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-15fd6ffc-51fb-4eb0-9a9b-84375236e21c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084776 Aug 03 09:57:35.521495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1233/2578] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:36.015687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:36.016299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:36.023383 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:36.023830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:36.024583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:36.025045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:36.155594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:36.163481 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1377cff5-ac1a-4b61-8245-525fa231cab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151708 Aug 03 09:57:36.164052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1346/2579] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:36 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:36.543038 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:36.543640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:36.550134 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:36.550572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:36.551318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:36.551742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:36.617174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:36.625207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e513f9c1-1fb7-4b0b-ba11-727b393028dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086035 Aug 03 09:57:36.625776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1234/2580] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:37.184229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:37.184851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:37.191533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:37.191974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:37.192721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:37.193204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:37.325841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:37.333572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-741dffc6-117c-4ff3-ad5f-a6ab8072b69c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153183 Aug 03 09:57:37.334130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1347/2581] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:37.645567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:37.646851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:37.653397 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:37.653835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:37.654577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:37.655005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:37.715966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:37.724050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c0b1537c-7cd4-46b5-94ae-b53dc033d16d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082285 Aug 03 09:57:37.725389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1235/2582] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:38.353983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:38.354596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:38.361206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:38.361655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:38.362413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:38.362847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:38.493264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:38.501573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a53028f2-224f-4413-a17f-e63f4d6a8888 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151431 Aug 03 09:57:38.502143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1348/2583] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:38.746067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:38.746678 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:38.753161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:38.753609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:38.754364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:38.754798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:38.816138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:38.824521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-85bfec99-7051-4572-b81c-5ec608477562 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082325 Aug 03 09:57:38.825121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1236/2584] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:39.523395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:39.524026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:39.530550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:39.530992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:39.531774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:39.532204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:39.546618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:39.663374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:39.671387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-83ef2790-584c-4750-b010-1faf377f2299 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152611 Aug 03 09:57:39.671945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1349/2585] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:39.850063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:39.850674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:39.857139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:39.857585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:39.858341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:39.858774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:39.919813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:39.928351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8411b5f9-2b4c-4a1e-93ca-3851fb6ac346 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082134 Aug 03 09:57:39.928943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1237/2586] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:40.692355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:40.693112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:40.699771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:40.700222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:40.701283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:40.701714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:40.828292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:40.836801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-47a87210-3fa6-4f9d-a52f-a443d41bea5c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148282 Aug 03 09:57:40.837396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1350/2587] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:40.949232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:40.949793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:40.956505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:40.956974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:40.957722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:40.958148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:41.023601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:41.032075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-04ecdd73-93f7-424e-8c9b-b4829c190eb7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086686 Aug 03 09:57:41.032877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1238/2588] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:41.858291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:41.858899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:41.866527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:41.866973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:41.867730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:41.868164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:42.002445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:42.010416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dff83513-13b6-43a3-9d91-fb9838bec71d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155946 Aug 03 09:57:42.010986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1351/2589] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:42.052954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:42.053581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:42.060016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:42.060462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:42.061248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:42.061690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:42.274049 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:42.281990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2a79a7b9-b30a-4c08-9f74-5a3c904c544d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.233112 Aug 03 09:57:42.282547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1239/2590] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:43.031896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:43.032512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:43.039142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:43.039593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:43.040386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:43.040846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:43.167395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:43.175281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-19062346-3eff-40cb-af5f-a5586c535ca1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147222 Aug 03 09:57:43.175850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1352/2591] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:43 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:43.303492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:43.304052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:43.310480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:43.310921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:43.311666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:43.312094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:43.372864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:43.380691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-391299e0-1b7f-4664-8183-f7dc90c575fd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081739 Aug 03 09:57:43.381255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1240/2592] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:44.198259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:44.199338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:44.206977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:44.206977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:44.207246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:44.207611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:44.350536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:44.358795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-94b4850f-0773-41fa-b70d-3e0d270a4628 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.165613 Aug 03 09:57:44.359364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1353/2593] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:44.401769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:44.402374 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:44.409591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:44.410029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:44.410801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:44.411247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:44.477658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:44.486960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ab41f1c5-f25e-4936-86ea-7bf43dfab0d2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.089123 Aug 03 09:57:44.487523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1241/2594] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:45.380711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:45.381386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:45.388561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:45.389036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:45.389788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:45.390202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:45.510921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:45.511601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:45.518179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:45.518636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:45.519401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:45.519834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:45.525437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:45.533275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-afd3cf5b-6f3a-4272-ae5c-98adfdda1ef4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156409 Aug 03 09:57:45.533841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1354/2595] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:45.584497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:45.592373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7c851834-4897-4170-9dd0-970704ca4d2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085350 Aug 03 09:57:45.592950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1242/2596] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:46.555433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:46.556032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:46.562439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:46.562877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:46.563624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:46.564052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:46.613684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:46.614924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:46.622588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:46.623036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:46.623800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:46.624236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:46.698132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:46.706890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87105935-1af7-41b4-8f76-c5e127a8beed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155802 Aug 03 09:57:46.707594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1355/2597] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:46.933577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:46.941410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2a858337-8b87-4460-815c-18c26137f41b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.331632 Aug 03 09:57:46.941965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1243/2598] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:47.729173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:47.730028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:47.736718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:47.737198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:47.737954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:47.738388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:47.870043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:47.877925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a1b3aef-7eee-4bd0-8f04-a6da652ea0bb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153434 Aug 03 09:57:47.878492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1356/2599] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:47.962798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:47.963418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:47.969801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:47.970249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:47.970994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:47.971423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:48.033485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:48.042155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba25e8dc-395b-424f-9728-2119dedd68b7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083236 Aug 03 09:57:48.042707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1244/2600] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:47 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:48.899205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:48.899808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:48.906227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:48.906670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:48.907408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:48.907834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:49.037741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:49.046241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12f615d6-270e-4179-8d17-1fa13180ef3e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151441 Aug 03 09:57:49.046811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1357/2601] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:48 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:49.062900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:49.063506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:49.070056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:49.070539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:49.071258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:49.071686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:49.133803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:49.141539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-66873ac3-c849-43af-af0c-26917059b6e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082593 Aug 03 09:57:49.142097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1245/2602] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:50.067073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:50.067717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:50.074679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:50.075119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:50.076116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:50.076543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:50.162901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:50.163598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:50.170447 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:50.170895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:50.171659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:50.172094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:50.208546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:50.217708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7dc9c07-61a4-452b-8747-9964468c1664 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154416 Aug 03 09:57:50.218295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1358/2603] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:50 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:50.234510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:50.243104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cbec7bd8-4fed-4a44-bf7e-0cb2056dcaea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084056 Aug 03 09:57:50.243665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1246/2604] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:51.239397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:51.240009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:51.246535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:51.246986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:51.247750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:51.248187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:51.263519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:51.264122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:51.270557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:51.271004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:51.271761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:51.272193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:51.338940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:51.346859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5b63f4f2-f27d-4d0d-a74f-e5805aaaa9c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087142 Aug 03 09:57:51.355990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1247/2605] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:51.380791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:51.390089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ecccd4ed-84de-4c67-8377-b89b50baf84a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154066 Aug 03 09:57:51.390089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1359/2606] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:52.369368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:52.370007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:52.376557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:52.377042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:52.377800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:52.378233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:52.410766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:52.411469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:52.418640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:52.419116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:52.419934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:52.420353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:52.440457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:52.448450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fa432f1b-fdb4-433a-90fe-48acd40e856a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084108 Aug 03 09:57:52.449055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1248/2607] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:52.547212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:52.555175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ff8a9240-b62d-4174-9fc1-8156d32824b9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148469 Aug 03 09:57:52.555921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1360/2608] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:57:53.470816 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:53.471449 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:53.477679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:53.478121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:53.478872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:53.479303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:53.497557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:53.561503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:53.569701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a43c871-ea2e-4e6c-b5b5-7f0c0669d4be tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.102658 Aug 03 09:57:53.570917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1249/2609] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:53.576630 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:53.577412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:53.583875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:53.584321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:53.585111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:53.585600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:53.956512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:53.965319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-68df8173-a4d0-4286-b36b-53e769764fbb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.392717 Aug 03 09:57:53.965883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1361/2610] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:54.592126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:54.592709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:54.599147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:54.599589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:54.600334 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:54.600764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:54.665954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:54.673778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b736813f-5c51-4bc5-a8d0-2a60f1658917 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085506 Aug 03 09:57:54.674335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1250/2611] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:54.987132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:54.987741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:54.994827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:54.995272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:54.996024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:54.996457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:55.125473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:55.133458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e55f39fa-0c9b-4177-bfcf-f62224ddd092 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150195 Aug 03 09:57:55.134018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1362/2612] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:54 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:55.694581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:55.695249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:55.702195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:55.702646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:55.703403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:55.703837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:55.764390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:55.772260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6eda88b6-3d51-4cbe-b011-7519a627e777 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081650 Aug 03 09:57:55.773394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1251/2613] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:56.155164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:56.155771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:56.162236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:56.162670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:56.163522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:56.164097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:56.295076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:56.302906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-97981cfc-a474-4ade-a7f5-b901fb896adf tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151581 Aug 03 09:57:56.303468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1363/2614] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:56.794289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:56.794820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:56.801267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:56.801712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:56.802470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:56.802903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:56.865425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:56.874307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0bf3748a-3002-48de-9295-37049a7e7e8d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083920 Aug 03 09:57:56.874875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1252/2615] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:57.325299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:57.325841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:57.332579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:57.333059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:57.333841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:57.334275 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:57.464041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:57.471895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b01cddb6-f7f1-4651-9e49-03f7424a2829 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150572 Aug 03 09:57:57.472469 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1364/2616] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:57 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:57.894647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:57.895243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:57.901694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:57.902139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:57.902883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:57.903313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:57.964616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:57.972403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8367242a-85e7-46ed-a3bd-3ff4dcfa6e00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081631 Aug 03 09:57:57.972980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1253/2617] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:58.492583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:58.493152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:58.499780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:58.500230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:58.501016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:58.501455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:58.631562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:58.640106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4628080-b4a2-401e-a91a-f9c26043e07c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151445 Aug 03 09:57:58.640675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1365/2618] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:58.993153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:58.993763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:59.000207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:59.000662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:59.001453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:59.001889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:59.066862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:59.075746 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-839ed4b8-121f-4adb-a477-86a1e9c0e34a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086581 Aug 03 09:57:59.076559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1254/2619] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:57:59.661549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:57:59.662098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:57:59.669374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:59.669822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:59.670571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:57:59.671030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:57:59.674897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:57:59.798174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:57:59.806733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0ef9683d-2e34-44b1-adb9-5ec095143f71 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149112 Aug 03 09:57:59.807296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1366/2620] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:57:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:00.096984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:00.097587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:00.104858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:00.105300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:00.106048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:00.106477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:00.167057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:00.174829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c9f779d-6b4c-415e-9e2e-1e9b89e737c6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081713 Aug 03 09:58:00.175393 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1255/2621] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:00.827860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:00.828473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:00.835064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:00.835512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:00.836787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:00.837246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:00.969981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:00.978138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a74189f6-e891-4277-bd2e-577a627b109b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154422 Aug 03 09:58:00.978700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1367/2622] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:01.196005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:01.196606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:01.203305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:01.203757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:01.204504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:01.204954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:01.265568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:01.274074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-22e113b0-b441-407d-ad11-62b131a9b4a3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081490 Aug 03 09:58:01.274640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1256/2623] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:01.999322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:01.999927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:02.006306 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:02.006747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:02.007488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:02.007973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:02.137157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:02.145025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3aceefb8-4b12-4590-a4f9-36ecd7bd264e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149502 Aug 03 09:58:02.145590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1368/2624] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:01 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:02.295890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:02.296454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:02.302955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:02.303400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:02.304155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:02.304588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:02.365462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:02.373370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a4a4a56c-bbde-40cf-bc24-6ffd52a77b57 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081414 Aug 03 09:58:02.373937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1257/2625] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:03.166585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:03.167190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:03.173643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:03.174106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:03.174849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:03.175278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:03.302603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:03.310863 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fa69f1d9-ca69-4a0b-936f-76dd7c958f78 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148721 Aug 03 09:58:03.311360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1369/2626] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:03.393940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:03.394604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:03.401946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:03.402395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:03.403161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:03.403599 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:03.469090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:03.477148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-551746e9-87f8-4555-8283-2d7407f04772 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086965 Aug 03 09:58:03.477722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1258/2627] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:04.340929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:04.341545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:04.348453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.349224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.350225 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.351241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.427593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:04.428040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:04.435346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=54 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:04.439011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.439476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.440280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.440705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.473505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 09:58:04.518030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:04.526718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2cdf4cb-ed4e-427f-94f4-1df3264bc391 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.195860 Aug 03 09:58:04.527325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1370/2628] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:04 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:04.545457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:04.546305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:04.552147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.552568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.553388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.553821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.556630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a9ee72d-5db2-400e-9307-b2e04fa7980a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 204 len: 0 microversion: 2.1 time: 0.132722 Aug 03 09:58:04.557562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1259/2629] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 09:58:04 2022] DELETE /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 09:58:04.566713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:04.567411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:04.573844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.574349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.575139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:04.575593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:04.620329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:04.628647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67965ba5-3046-4a15-87ae-7c44c6bbda88 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086889 Aug 03 09:58:04.629243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1371/2630] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:04.705237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:04.713790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9902338-7a40-4015-88c3-b68cbbfd7688 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152138 Aug 03 09:58:04.714357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1260/2631] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:05.547679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:05.548283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:05.550589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=54 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:05.555999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.556441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.557217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.557648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.650011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:05.650831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:05.657370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.657817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.658581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.659014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.686492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:05.694474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd11401d-52a6-4d34-9a7b-8e376af53603 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150666 Aug 03 09:58:05.695052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1372/2632] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:05.721539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:05.729576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a7f2f783-7de1-4b51-baa0-68ee341fea62 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084173 Aug 03 09:58:05.730308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1261/2633] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:05.735343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:05.735974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:05.742006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.742456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.743860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:05.744308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:05.874103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:05.881882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ce7b370-4019-49c1-ab9f-68d517ffe90f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150454 Aug 03 09:58:05.882454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1373/2634] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:06.716558 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:06.717195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:06.723673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.724123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:06.724981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.725422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:06.750368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:06.750976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:06.757528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.757971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:06.758723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.759154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:06.821735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:06.830345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d4642ed-2533-4b4b-a71b-edd0be05623b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084111 Aug 03 09:58:06.831060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1374/2635] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:06.859626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:06.867426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b8f903b9-24b5-4001-8a59-4a4baf63c2da tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155429 Aug 03 09:58:06.867987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1262/2636] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:06.903593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:06.904200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:06.910118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.910558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:06.911301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:06.911730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:07.045542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:07.053442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5182e11c-062f-4693-a81e-ffa06594cd2e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154108 Aug 03 09:58:07.054005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1375/2637] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:07.851926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:07.852539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:07.859687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:07.860132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:07.860911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:07.861344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:07.887461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:07.888067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:07.894316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:07.894759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:07.895506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:07.895933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:07.923848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:07.933237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b0a1169-b49c-492b-8da7-2d8372764e4d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085114 Aug 03 09:58:07.933811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1263/2638] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:08.024069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:08.032140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1fb3d8cd-9e42-4eeb-9b51-d9fcdcf6e1d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148565 Aug 03 09:58:08.032698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1376/2639] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:07 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:08.074878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:08.075487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:08.081947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:08.082405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:08.083172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:08.083611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:08.098669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:08.216533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:08.224367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9e08e1b2-94fa-4f6c-92a5-4b0d79da1d5b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153744 Aug 03 09:58:08.224947 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1264/2640] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:08.954270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:08.954884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:08.961359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:08.961810 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:08.962570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:08.963001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:09.023709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:09.032003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc233283-6e4a-46be-a72b-b949430c3bc1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081922 Aug 03 09:58:09.032567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1377/2641] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:09.053670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:09.054278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:09.062118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:09.062670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:09.063446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:09.063881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:09.194131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:09.202870 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fb0eb88e-83bf-438b-8417-92eaf5cb768b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153051 Aug 03 09:58:09.203428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1265/2642] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:09 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:09.245628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:09.246193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:09.252136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:09.252578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:09.253357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:09.253788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:09.387439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:09.395268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-244558d7-b84e-4f4c-8684-3765897c2cd7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154145 Aug 03 09:58:09.395822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1378/2643] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:10.052288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:10.052920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:10.060027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.060638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.061276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.061840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.123530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:10.131370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-76494396-b00e-4d34-9830-4178196322f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082986 Aug 03 09:58:10.131937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1266/2644] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:10.224021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:10.224558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:10.231410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.231857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.232606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.233062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.362711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:10.370919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-653ce710-3813-457b-978b-65b2e3ee229d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150791 Aug 03 09:58:10.371484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1379/2645] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:10.416552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:10.417173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:10.423162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.423639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.424395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:10.424849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:10.552739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:10.561363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b1b4f83f-416c-4e72-ba08-0ac132975072 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148752 Aug 03 09:58:10.561916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1267/2646] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:11.153378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:11.153989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:11.160014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.160459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.161239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.161673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.222669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:11.230973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df1bacc6-edb6-4bbc-9763-4093d6ac627e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082516 Aug 03 09:58:11.231593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1380/2647] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:11.391770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:11.392379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:11.399096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.399345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.400222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.400700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.535286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:11.544228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-19cddf4b-82e5-4fb2-9e60-a3b49e170a83 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.156463 Aug 03 09:58:11.544790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1268/2648] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:11 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:11.582905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:11.583509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:11.589666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.590110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.590852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:11.591285 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:11.721800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:11.734419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-050556cc-5e16-4dce-b384-6f62c724426f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154962 Aug 03 09:58:11.735454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1381/2649] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:12.251578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:12.252181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:12.258398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.258847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.260331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.260774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.323878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:12.332144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aa5bfdd6-5057-4670-ac58-6f24850bc81a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084433 Aug 03 09:58:12.332705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1269/2650] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:12 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:12.565691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:12.566297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:12.573526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.573913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.574710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.575144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.702729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:12.704930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:12.711818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd7fadf5-c21b-4465-a454-994681b5d7c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149983 Aug 03 09:58:12.712949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1382/2651] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:12.755654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:12.756256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:12.762704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.763146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.763895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:12.764322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:12.890596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:12.898555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3d4e529-2625-46bb-b698-c88423c7c38d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147061 Aug 03 09:58:12.899112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1270/2652] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:13.353039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:13.353671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:13.359675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.360122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:13.360910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.361349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:13.425075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:13.434575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12522afb-ff23-4df4-aaa6-5feece6cdf0c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085428 Aug 03 09:58:13.435146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1383/2653] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:13.733096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:13.733626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:13.739677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.740129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:13.740911 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.741347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:13.870636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:13.878576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f3e368e6-8f1c-43e9-b525-0abb5867fe2e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149464 Aug 03 09:58:13.879139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1271/2654] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:13.920054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:13.920663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:13.927212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.927652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:13.928397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:13.928833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:14.060543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:14.068457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b2abe867-f5d1-4782-bacd-8f3a4a9ce520 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152197 Aug 03 09:58:14.069041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1384/2655] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:14.456115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:14.456724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:14.463418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:14.463958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:14.464717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:14.465178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:14.526983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:14.534867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-500ad7f9-0511-4525-b1ce-8afc84ec064b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082898 Aug 03 09:58:14.535495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1272/2656] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:14.900504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:14.901233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:14.907269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:14.907711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:14.908449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:14.908897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:15.034840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:15.042851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e8f44f2c-d1c7-421a-a11a-52f792a78993 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146948 Aug 03 09:58:15.043414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1385/2657] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:14 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:15.090107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:15.090717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:15.097193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:15.097637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:15.098392 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:15.098824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:15.229846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:15.237770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bbcfd26c-0dbf-4761-b5f6-bfb38a5429f6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151706 Aug 03 09:58:15.238331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1273/2658] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:15.557059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:15.557593 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:15.563980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:15.564423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:15.565193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:15.565624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:15.626021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:15.633663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6c6633c0-b9c4-412b-aa45-7986306e0e24 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080925 Aug 03 09:58:15.634742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1386/2659] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:16.063994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:16.064609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:16.070787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.071236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.072173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.072796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.199751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:16.207964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6596a076-246e-4652-b46b-c0cf8f8436a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147820 Aug 03 09:58:16.208521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1274/2660] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:16 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:16.257693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:16.258305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:16.265080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.265527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.266278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.266708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.397941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:16.406651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c44e79c-c223-4053-9923-b14778cc62bb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152839 Aug 03 09:58:16.407224 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1387/2661] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:16.654722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:16.655361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:16.661320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.661767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.662529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:16.662961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:16.724619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:16.732607 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e7a9465-3856-4054-9840-8f579335519d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082093 Aug 03 09:58:16.733233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1275/2662] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:17.230026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:17.230637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:17.236699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.237177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.237930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.238366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.365493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:17.373747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ac71f2c-b1dd-4913-ac61-873b18b37ce0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148234 Aug 03 09:58:17.374347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1388/2663] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:17.427347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:17.427959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:17.434839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.435322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.436090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.436531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.581430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:17.589946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3cb9ad81-6b5c-4f00-88c4-52cc887542c5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.166423 Aug 03 09:58:17.590511 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1276/2664] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:17.753953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:17.754558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:17.761043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.761509 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.762251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:17.762677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:17.827060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:17.834862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6695e615-e718-477a-80c4-26ead7899d89 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084690 Aug 03 09:58:17.835364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1389/2665] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:18.395155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:18.395759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:18.402488 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.402923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.403666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.404099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.531857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:18.539659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eaef532d-066e-4fce-ba0a-34d7ee016eb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148427 Aug 03 09:58:18.540217 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1277/2666] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:18 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:18.610768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:18.611377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:18.617822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.618263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.619015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.619443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.747265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:18.755123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87834627-62d4-44f6-87b1-7c06abd69157 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148226 Aug 03 09:58:18.755697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1390/2667] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:18.856246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:18.856872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:18.862839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.863285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.864068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:18.864501 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:18.925252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:18.934105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b727c3e-0f72-4b36-8c7a-8b56269395e2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082208 Aug 03 09:58:18.934664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1278/2668] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:19.560523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:19.561157 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:19.567214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.567657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:19.568400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.568848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:19.695061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:19.703258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fbfe9715-c949-4df0-8ba6-b79215bdb4d1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146679 Aug 03 09:58:19.703819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1391/2669] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:19.778333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:19.778943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:19.785560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.785944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:19.786694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.787124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:19.917852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:19.925818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3bd6d7e6-cd82-4782-bf95-97152e039823 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152375 Aug 03 09:58:19.926394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1279/2670] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:19.955873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:19.956422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:19.963361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.963738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:19.964634 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:19.965028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:20.031622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:20.039540 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5bcbf2f0-07a4-44ae-8d5f-8c2abf896f92 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087878 Aug 03 09:58:20.040105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1392/2671] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:20.724050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:20.724646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:20.731053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:20.731491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:20.732233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:20.732658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:20.859444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:20.867264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-513edef2-0890-464d-a226-1d07f45eb0d4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147054 Aug 03 09:58:20.867820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1280/2672] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:20.946221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:20.947475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:20.954250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:20.954696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:20.955471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:20.955902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:21.060226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:21.060865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:21.067273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:21.067722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:21.068496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:21.068955 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:21.074263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:21.087436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:21.095233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4c9aafe5-ece4-4e41-b403-d8b47bbf349f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152856 Aug 03 09:58:21.095798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1393/2673] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:21.133668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:21.141604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fd5b73e0-cd8d-4951-86f3-f73979a2e85a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086030 Aug 03 09:58:21.142248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1281/2674] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:21.888151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:21.888765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:21.894727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:21.895167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:21.895906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:21.896333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:22.023715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:22.031560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5accf066-083c-4c0e-8e91-8d114e1df88c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147949 Aug 03 09:58:22.032115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1394/2675] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:21 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:22.116567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:22.117197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:22.124398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:22.124874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:22.125631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:22.126065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:22.162759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:22.163403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:22.170076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:22.170518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:22.171269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:22.171696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:22.237404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:22.245928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bd7d68b6-88f2-4845-b105-22ceb828f4ca tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087030 Aug 03 09:58:22.246492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1395/2676] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:22.259394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:22.267276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bfad27e5-e41c-4073-8c6f-816a0aa52c72 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154617 Aug 03 09:58:22.267824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1282/2677] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:23.052974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:23.053597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:23.061211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.061655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.062412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.062838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.190708 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:23.198599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9752f1ad-f722-43db-b683-78746de41a40 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149632 Aug 03 09:58:23.199163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1396/2678] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:23 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:23.266602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:23.267792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:23.274136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.274574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.275966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.276389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.289223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:23.289843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:23.296427 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.296910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.297678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:23.298113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:23.338756 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:23.346828 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-687a7ea4-0da4-416a-a1ef-d3069fd9214d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084265 Aug 03 09:58:23.347405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1283/2679] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:23 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:23.426262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:23.434279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-69a81aa9-25cc-499a-8c94-6ffc9f70f70f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148878 Aug 03 09:58:23.434841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1397/2680] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:24.221262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:24.221872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:24.228003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.228490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.229398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.229837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.360780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:24.367388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:24.368134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:24.369627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba6f7a39-2e8a-496b-a59b-64ad8a334b97 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151545 Aug 03 09:58:24.370199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1284/2681] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:24.375790 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.376307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.377163 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.377661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.445219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:24.453974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0cb214e0-c358-4e3f-9244-6cf7a2a4bab2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.090420 Aug 03 09:58:24.454536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1398/2682] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:24.455660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:24.456274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:24.462314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.463419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.464188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:24.464624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:24.594972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:24.602755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba6ed694-9a1c-49ec-9d99-c10907ff8233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151360 Aug 03 09:58:24.603420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1285/2683] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:25.390495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:25.391099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:25.397625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.398065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.398803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.399229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.413855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:25.474809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:25.475421 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:25.482708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.483156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.483927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.484367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.530442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:25.538376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2b0626da-4803-4812-9eb7-99ec0a392430 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151762 Aug 03 09:58:25.538940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1399/2684] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:25 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:25.546886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:25.554913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4d75462d-1e8d-4aa3-ad62-e906c1c96b52 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084041 Aug 03 09:58:25.555480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1286/2685] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:25.624460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:25.625098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:25.631062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.631501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.632243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:25.632670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:25.764043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:25.772162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f71eff8-4075-4773-91d1-56f5bdb9da13 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151566 Aug 03 09:58:25.772769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1400/2686] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:26.561709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:26.562693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:26.572754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.573223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.573991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.574426 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.581233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:26.581966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:26.589234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.590282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.591051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.591486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.658061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:26.667074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e3fe0a5a-370f-4009-891c-e43649b4e45f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.089855 Aug 03 09:58:26.667661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1401/2687] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:26.705997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:26.714577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ece47eb-db89-4d9f-94e9-93f5fb0cc3fb tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.158323 Aug 03 09:58:26.715129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1287/2688] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:26.793909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:26.794515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:26.800407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.800878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.801650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:26.802080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:26.928839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:26.937181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b79c58d-2a91-415d-b86d-37a64e48d002 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147287 Aug 03 09:58:26.937736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1402/2689] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:27.688143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:27.688665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:27.695162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.695610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:27.696356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.697461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:27.735299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:27.735904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:27.742325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.742764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:27.743523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.743943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:27.759729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:27.767831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e09c7cf3-b746-4378-89d0-b249d057e229 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083637 Aug 03 09:58:27.768508 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1288/2690] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:27.870012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:27.877830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-390caca4-4612-4fa1-9e9e-f42063e9b237 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146288 Aug 03 09:58:27.878387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1403/2691] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:27.958928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:27.959468 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:27.966031 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.966483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:27.967272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:27.967707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:28.097247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:28.105366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a02e9f2-771d-4e48-af12-e6d6156a9fe3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150407 Aug 03 09:58:28.105932 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1289/2692] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:28.788348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:28.789004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:28.796073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:28.796519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:28.797299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:28.797737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:28.861506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:28.869417 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b422efb7-d2b7-40e4-b273-8b67b6450518 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084999 Aug 03 09:58:28.870682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1404/2693] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:28.898381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:28.898981 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:28.905513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:28.905952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:28.906699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:28.907124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:29.036629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:29.045115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e0394122-9537-4f72-a61f-8118476b0a73 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150416 Aug 03 09:58:29.045617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1290/2694] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:28 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:29.126840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:29.127511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:29.133490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:29.133932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:29.134676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:29.135106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:29.263012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:29.270935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de83cf07-61ba-40df-a6b4-4cf97c447fdc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147988 Aug 03 09:58:29.271492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1405/2695] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:29.891360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:29.891970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:29.897965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:29.898405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:29.899154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:29.899580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:29.962781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:29.971899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6dfe9263-0356-4f96-87f4-80b3008f740d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084523 Aug 03 09:58:29.972474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1291/2696] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:30.066652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:30.067494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:30.074766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:30.075206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:30.075953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:30.076379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:30.201080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:30.209122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-aee3ce79-b926-49f7-b68a-0769761d80a0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146570 Aug 03 09:58:30.209678 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1406/2697] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:30 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:30.292858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:30.293471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:30.299523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:30.299966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:30.300727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:30.301197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:30.427227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:30.435598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c05873c4-df42-4244-b653-abd3ac1eb9ac tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146903 Aug 03 09:58:30.436165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1292/2698] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:30.992739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:30.993377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:31.000130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.000580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.001426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.001869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.066473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:31.074571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-72437ab8-ddc2-4701-b0cc-117efa9992bb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085706 Aug 03 09:58:31.075268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1407/2699] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:31.231087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:31.231691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:31.238381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.238851 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.239634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.240061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.371705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:31.379663 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1a396dd5-bf1c-4adb-8913-64bd37a5c498 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152987 Aug 03 09:58:31.380224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1293/2700] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:31 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:31.456989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:31.457604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:31.464338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.464936 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.465696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:31.466130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:31.596202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:31.604743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8f0b2e13-45d0-46fc-bfef-d59dc167ac6c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151076 Aug 03 09:58:31.605344 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1408/2701] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:32.095681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:32.096300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:32.102456 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.102902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.103661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.104103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.164270 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:32.172478 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f352905-d48c-4ccd-9e08-9e84faee64a9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080689 Aug 03 09:58:32.173071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1294/2702] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:32.400370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:32.401133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:32.407757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.408197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.408967 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.409391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.539657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:32.548043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3386335-ce90-4d5e-91b8-ae7baeae9248 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151450 Aug 03 09:58:32.548605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1409/2703] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:32.626054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:32.626662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:32.633070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.633520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.634275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:32.634709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:32.763665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:32.771641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c4ad682-1c12-48f3-8184-bfbae4bf06b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149399 Aug 03 09:58:32.772220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1295/2704] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:33.193168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:33.193777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:33.200399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.200856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.201606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.202031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.416322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:33.424996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-06a584a3-dfb9-4f82-b0db-627bc9ef6461 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.235646 Aug 03 09:58:33.425552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1410/2705] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:33.569953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:33.570568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:33.577015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.577733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.578495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.584435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.718110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:33.726019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d1ff2495-b27d-49c1-aad3-3e604d4f7dce tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.159941 Aug 03 09:58:33.726583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1296/2706] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:33 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:33.792475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:33.793102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:33.798965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.799405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.800140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:33.800566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:33.926545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:33.934564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-869887a2-a6ac-4306-9fdf-556b7dc5fdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146588 Aug 03 09:58:33.935109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1411/2707] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:34.446414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:34.447054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:34.449736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:34.455568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.456011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:34.456766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.457236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:34.519318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:34.521500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:34.529005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c03fab3f-5c0e-406e-b640-49033a559b74 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086424 Aug 03 09:58:34.529573 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1297/2708] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:34 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:34.748221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:34.748753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:34.755182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.755626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:34.756372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.756803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:34.882722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:34.890635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fe4b9a80-3749-4af0-9d04-9406e8e99b8a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147035 Aug 03 09:58:34.891198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1412/2709] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:34 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:34.955760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:34.956367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:34.962743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.963205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:34.964168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:34.964589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:35.091718 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:35.099564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51c16465-bdcc-4b42-afdd-b335c29eaf0d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148067 Aug 03 09:58:35.100123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1298/2710] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:35.549927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:35.550531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:35.556538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:35.557181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:35.558136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:35.558572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:35.624181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:35.632078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fbcb769b-b0a8-43b4-8099-9c4dab92251a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085965 Aug 03 09:58:35.632632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1413/2711] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:35.911620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:35.912210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:35.918260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:35.918709 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:35.919461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:35.919887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:36.050809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:36.059464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b03aa19-e8c5-4831-b240-f576d796922c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151789 Aug 03 09:58:36.060041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1299/2712] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:35 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:36.121947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:36.122561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:36.124941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=84 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:36.130237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:36.130686 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:36.131446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:36.131881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:36.262702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:36.270594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0250cbc0-1b37-4e11-ac76-2be333fd458d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153394 Aug 03 09:58:36.271151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1414/2713] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:36.654469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:36.655070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:36.661107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:36.661549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:36.662297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:36.662721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:36.723644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:36.732278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6b349b52-85e7-4422-bd27-c8dd78d7ca4e tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082349 Aug 03 09:58:36.732844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1300/2714] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:37.081228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:37.081940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:37.087969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.089073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.089938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.090367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.217548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:37.225446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-939e1748-566c-488f-8a27-a0f037ce309c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148474 Aug 03 09:58:37.226008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1415/2715] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:37 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:37.291390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:37.292197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:37.298651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.299092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.299845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.300276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.431865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:37.440433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0457dfec-998c-4cc9-9bbc-229df272451a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152930 Aug 03 09:58:37.441026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1301/2716] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:37.753104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:37.753718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:37.759680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.760870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.761705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:37.762139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:37.765984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:37.828483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:37.836356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-65ed6c2d-669a-4e28-9c5d-e13b14612f30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087141 Aug 03 09:58:37.836935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1416/2717] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:38.246831 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:38.247507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:38.253666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.254115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.254878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.255311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.387182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:38.395108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a67fc32-35be-47d7-ab08-d2e770d91edd tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152644 Aug 03 09:58:38.396288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1302/2718] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:38 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:38.462506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:38.463136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:38.469987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.470442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.471217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.471656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.602223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:38.610771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3a42a3f-cfbb-451d-80f4-9c86f68e9697 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152079 Aug 03 09:58:38.611323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1417/2719] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:38.858118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:38.858650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:38.864684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.865167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.865930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:38.866369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:38.927280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:38.935557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7ac11dd3-dc2e-49e0-8787-6288740b0e91 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081950 Aug 03 09:58:38.936131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1303/2720] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:39.415913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:39.417218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:39.423241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.423681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:39.424426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.424882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:39.553783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:39.562057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-52b4925c-36d2-49ec-8b3f-fa72fa16ad80 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149987 Aug 03 09:58:39.562613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1418/2721] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:39 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:39.632255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:39.632886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:39.639688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.640137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:39.640924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.641361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:39.770812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:39.779652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f088f80a-03d6-4dcc-840e-234d90380b1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151085 Aug 03 09:58:39.780228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1304/2722] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:39.956165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:39.956768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:39.962857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.963323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:39.964841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:39.965241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:40.029728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:40.037544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-47708aae-d367-466d-99e0-34b4ddfecd02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085474 Aug 03 09:58:40.038090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1419/2723] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:40.583682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:40.584288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:40.590813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:40.591251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:40.591997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:40.592423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:40.719251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:40.727166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8cec6cc-2d62-47a9-a54b-3c2e514e069a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147367 Aug 03 09:58:40.727732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1305/2724] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:40 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:40.801992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:40.802617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:40.809874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:40.810329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:40.811089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:40.811526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:40.938192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:40.946073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c6868ba6-8f3a-4ea4-84bb-7df037b23bea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147967 Aug 03 09:58:40.946631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1420/2725] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:41.059128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:41.059736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:41.065922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.066367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:41.067119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.067544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:41.128641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:41.136484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8f19c87-0c6c-43a1-88fa-406f84141f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081978 Aug 03 09:58:41.137080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1306/2726] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:41.748845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:41.749373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:41.755564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.756006 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:41.756757 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.757213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:41.883643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:41.892052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3f1d6045-87c8-4fbf-8fe8-728b963f56c4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147280 Aug 03 09:58:41.892607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1421/2727] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:41 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:41.967402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:41.968007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:41.974669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.975114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:41.975903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:41.976336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:42.106350 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:42.114234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-485902dc-c86d-4b12-8d03-370dbca2ede1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150770 Aug 03 09:58:42.114794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1307/2728] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:42.157181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:42.157793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:42.163745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:42.164187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:42.164964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:42.165400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:42.230401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:42.238396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6b4ba2d9-abd4-4096-aab4-9bbe70ed3b30 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085186 Aug 03 09:58:42.238960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1422/2729] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:42.914166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:42.914778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:42.921080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:42.921533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:42.922295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:42.922731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:43.048525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:43.056682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1afb709d-5ade-44b4-9e2d-705c6d44a3c5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146369 Aug 03 09:58:43.058199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1308/2730] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:42 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:43.136106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:43.136707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:43.143256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:43.143700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:43.144444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:43.144896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:43.259461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:43.260335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:43.266772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:43.267294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:43.268131 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:43.268568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:43.272467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:43.282350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-15c59d45-d44c-4dac-b6a1-73ec0ecbea1a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150114 Aug 03 09:58:43.283249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1423/2731] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:43.331933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:43.341050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a3dbea7-b8d3-45bb-851e-c734ad2cec40 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085473 Aug 03 09:58:43.341628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1309/2732] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:44.079228 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:44.079847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:44.085822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.086262 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.087002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.087450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.214339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:44.222112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd2cb3ca-695b-4f3a-83b7-623540ccd606 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.146958 Aug 03 09:58:44.222672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1424/2733] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:44 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:44.304111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:44.304770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:44.312227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.312676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.313469 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.313907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.362115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:44.362756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:44.368685 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.369162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.370992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:44.371437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:44.439300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:44.447161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb27ce33-51c4-4a29-aebd-a440555c8c4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088848 Aug 03 09:58:44.448428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1425/2734] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:44.448712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:44.457177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5d450051-ea22-48c9-a6af-ca634427ca41 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156922 Aug 03 09:58:44.457737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1310/2735] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:45.243767 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:45.244377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:45.251140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.251583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.252333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.252763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.380784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:45.389367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4cf1dd89-6fe8-480f-83dd-2891ee8d015c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149444 Aug 03 09:58:45.389927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1426/2736] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:45 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:45.470095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:45.470732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:45.477451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.477892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.478009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:45.478546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:45.478668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.479222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.484648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.485137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.485890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:45.486322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:45.542379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:45.550549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8187a409-827e-456f-ad9e-e1aa222692cc tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084306 Aug 03 09:58:45.551453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1311/2737] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:45 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:45.614511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:45.623355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c2758384-ddcb-4b6a-9c77-43ab6bed77fa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149279 Aug 03 09:58:45.623918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1427/2738] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:46.410715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:46.411317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:46.418700 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.419138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.419892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.420320 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.571820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:46.572573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:46.578929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:46.580111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.580657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.581459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.581888 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.586986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bcf5df94-7f7e-4a52-96ee-631371f28228 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.180055 Aug 03 09:58:46.587890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1312/2739] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:46 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:46.646138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:46.646778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:46.654076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.654076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.654791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:46.654791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:46.660338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:46.671539 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1bb66827-5f69-4ad1-b1bd-b26b1e9cb29f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.103401 Aug 03 09:58:46.672040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1428/2740] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:46.793409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:46.801269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4737d48c-23a6-4425-a8f2-2206677857ed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.159630 Aug 03 09:58:46.801836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1313/2741] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:47.320349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:58:47.320581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 09:58:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 09:58:47.609954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:47.610562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:47.617007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.617451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.618197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.618632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.691723 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:47.692419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:47.699679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.700123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.700915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.701351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.719512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:47.749415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:47.757309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10292f37-9533-4374-bebb-1d1250872009 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151199 Aug 03 09:58:47.758067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1429/2742] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:47 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:47.768075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:47.777004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-846fb332-386c-41df-83f5-be8bd2db2d00 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088133 Aug 03 09:58:47.777141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1314/2743] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:47 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:47.823697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:47.824301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:47.831124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.831567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.832351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:47.832765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:47.969247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:47.977293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-543ff665-2525-4945-b35c-a9d48d4f210b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.157890 Aug 03 09:58:47.977860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1430/2744] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:48.779875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:48.780417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:48.786875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:48.787311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:48.788057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:48.788482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:48.798155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:48.798794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:48.805212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:48.805701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:48.806398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:48.806829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:48.872423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:48.880488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-78d98053-8571-4172-a1c5-2a7736e1d6f8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086083 Aug 03 09:58:48.881096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1431/2745] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:48.922197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:48.930233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25152162-315f-4cbd-bf51-8711f860bdb6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154853 Aug 03 09:58:48.930786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1315/2746] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:48 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:48.999112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:48.999733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:49.005769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.006218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.006978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.007415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.136647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:49.138845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:58:49.145677 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e05f6027-08ac-464e-a369-7ea1a7609e8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151164 Aug 03 09:58:49.146245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1432/2747] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:49.902288 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:49.903544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:49.910825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.911263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.912014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.912439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.952087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:49.953599 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:49.960075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.960517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.961299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:49.961727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:49.975028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:49.983997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-623ee34e-9577-41e4-b21d-eebfc0790b78 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085531 Aug 03 09:58:49.984834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1316/2748] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:50.099339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:50.107921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04ee1168-5604-47e6-b780-843ffdbeead3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.160346 Aug 03 09:58:50.108486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1433/2749] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:49 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:50.166604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:50.167302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:50.173264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:50.173730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:50.174476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:50.174900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:50.302855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:50.311845 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c89ea35-11ca-4cd8-877e-337c35c33b94 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149082 Aug 03 09:58:50.312413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1317/2750] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:51.010461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:51.011782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:51.018455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.018905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.019662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.020098 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.086020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:51.094579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c00f83d-449d-4d10-b241-aaf49ed5aa26 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087959 Aug 03 09:58:51.095138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1434/2751] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:51.128072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:51.128676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:51.135081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.136171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.137061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.137486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.268408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:51.276604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-46a56915-8d25-4e94-b3f3-6672b04951fe tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152324 Aug 03 09:58:51.277204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1318/2752] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:51 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:51.333702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:51.334313 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:51.340465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.340961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.341755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:51.342197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:51.473092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:51.481642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e74da66c-2663-495d-aee0-f4d059bfe910 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151799 Aug 03 09:58:51.482200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1435/2753] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:52.115444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:52.116052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:52.122923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.123375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.124135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.124575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.186693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:52.194575 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2d4250b0-cfbb-4ee7-956f-bdc205794b4b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083008 Aug 03 09:58:52.195136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1319/2754] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:52.298270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:52.298881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:52.305420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.305808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.306566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.307638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.435233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:52.443061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-967e3bbe-d923-429f-8320-458ec1c23fd8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148775 Aug 03 09:58:52.443620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1436/2755] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:52 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:52.503423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:52.504022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:52.509986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.511233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.511982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:52.512414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:52.640725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:52.648560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eafe459f-9f96-4cf1-8a17-5bea25d566b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148993 Aug 03 09:58:52.649142 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1320/2756] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:53.215502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:53.216119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:53.222193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.222637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.223395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.223830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.288272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:53.296562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5484a044-95f0-42d2-8957-425f74137381 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084927 Aug 03 09:58:53.297202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1437/2757] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:53.465267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:53.465929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:53.471874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.472313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.473076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.473502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.604414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:53.612351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3eb721b-979f-4f95-bdfe-47d90053738b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151317 Aug 03 09:58:53.612930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1321/2758] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:53 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:53.670092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:53.670614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:53.677038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.677489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.678244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:53.678679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:53.813366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:53.821234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76cc5941-62be-42e0-96f0-05aceaa7a692 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155377 Aug 03 09:58:53.821796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1438/2759] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:54.318254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:54.319385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:54.325484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.325921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.326681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.327111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.391669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:54.399591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-68e07e73-840e-4409-a2f2-1ac2883aa03c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085284 Aug 03 09:58:54.400152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1322/2760] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:54.633333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:54.633990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:54.640463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.640935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.641689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.642117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.770868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:54.779395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0fe370e-ed54-4265-88bf-d7a7fef47666 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149903 Aug 03 09:58:54.779955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1439/2761] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:54 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:54.843782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:54.844386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:54.850877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.851321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.852075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:54.852504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:54.981379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:54.989118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c87d2463-4413-4eed-83a3-55395c62c372 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149107 Aug 03 09:58:54.989676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1323/2762] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:55.421668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:55.422280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:55.428379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:55.428848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:55.429608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:55.430038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:55.495779 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:55.503620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd782e40-67d1-420f-9cd7-52f578a9475d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086004 Aug 03 09:58:55.504176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1440/2763] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:55 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:55.801106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:55.801708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:55.807696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:55.808124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:55.808884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:55.809312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:55.942639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:55.951019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9f13726b-4f3d-4471-8080-7ff2473ad868 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153787 Aug 03 09:58:55.951588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1324/2764] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:55 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:56.010837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:56.011452 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:56.017995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.018447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:56.019210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.019652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:56.149975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:56.158541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a97cd1e5-bf8e-4f5c-8b19-77acd49c0024 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152138 Aug 03 09:58:56.159109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1441/2765] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:56.524165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:56.524850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:56.530982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.531423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:56.532180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.532615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:56.596931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:56.605434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bf0120cd-75cf-4a61-b2bf-3ce781c81544 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085152 Aug 03 09:58:56.605988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1325/2766] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:56.972924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:56.973542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:56.980310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.980755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:56.981542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:56.981979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:57.108561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:57.116484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3bb303c5-25b1-495d-a422-38ad2654d105 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147468 Aug 03 09:58:57.117079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1442/2767] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:56 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:57.179873 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:57.180485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:57.187409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:57.187859 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:57.188627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:57.189117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:57.315390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:57.324367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8558fca2-2981-4462-a420-39e96388de00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148259 Aug 03 09:58:57.324957 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1326/2768] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:57.626150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:57.626754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:57.632691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:57.633165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:57.633914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:57.634348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:57.699969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:57.708010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a3487f9e-7771-472c-992f-1c5fc5eb7a86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085761 Aug 03 09:58:57.708560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1443/2769] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:58.137492 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:58.138118 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:58.144221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.144662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.145433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.145861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.276860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:58.284451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce24b4d7-e579-4be1-bae4-c1424eacc4c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151495 Aug 03 09:58:58.285634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1327/2770] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:58 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:58:58.346571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:58.347138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:58.353697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.354270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.355065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.355502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.482840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:58.490644 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-32feb3e1-b66c-493a-94e8-65fa8ccb63a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148006 Aug 03 09:58:58.491211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1444/2771] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:58.728527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:58.729871 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:58.735925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.736370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.737150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:58.737586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:58.798948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:58.807135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6cbac1f9-c726-4777-8e63-68912eb9e814 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082300 Aug 03 09:58:58.808023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1328/2772] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:59.306735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:59.307819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:59.313891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.314331 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.315075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.315504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.446664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:59.455636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1a357df-c96f-4785-8088-f01fc1e57b64 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152864 Aug 03 09:58:59.456199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1445/2773] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:59 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:59.512595 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:59.513228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:59.519596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.520037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.520838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.521257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.652422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:59.660208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-35c55f67-a792-4f90-adfa-0c658fb94b53 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152107 Aug 03 09:58:59.660766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1329/2774] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:58:59.828048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:58:59.828930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:58:59.834836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.835282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.836026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:58:59.836457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:58:59.899812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:58:59.909150 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-afa7dfcb-4b5a-4d7d-8ff1-66b6686d1c01 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084894 Aug 03 09:58:59.909723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1446/2775] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:58:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:00.476886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:00.477416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:00.483639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.484086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.484875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.485316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.610658 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:00.618510 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e78d8903-79bb-471c-9735-eb60374ef915 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.145668 Aug 03 09:59:00.619073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1330/2776] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:00 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:00.682761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:00.683357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:00.690066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.690520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.691289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.691735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.820282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:00.829212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ca987bd8-c828-4484-be36-225837d175b5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150856 Aug 03 09:59:00.829777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1447/2777] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:00.929786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:00.930398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:00.937368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.937815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.938571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:00.939004 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:00.941546 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:01.001434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:01.009279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4fd253ce-9fb6-4f39-81f7-9e02aa6e22e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083299 Aug 03 09:59:01.009835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1331/2778] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:01.639610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:01.640222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:01.646296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:01.646742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:01.647492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:01.647927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:01.778421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:01.786508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-481c186d-f428-458b-ac74-675b84214dfc tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150891 Aug 03 09:59:01.787082 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1448/2779] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:01 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:01.850030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:01.850646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:01.857236 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:01.857687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:01.858452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:01.858893 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:01.991460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:01.999519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8ff5487-e0f4-4538-95f7-3444b465bc19 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153357 Aug 03 09:59:02.000082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1332/2780] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:02.030775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:02.031385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:02.037290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:02.037731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:02.038478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:02.038908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:02.053463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:02.103740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:02.111750 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ae2a29db-d186-4357-8fee-20139cd97cd9 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084764 Aug 03 09:59:02.112319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1449/2781] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:02 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:02.807894 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:02.808437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:02.814536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:02.814986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:02.815739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:02.816174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:02.943597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:02.952116 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-628839bd-1498-4b4b-b477-3da37cd9e820 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148445 Aug 03 09:59:02.952673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1333/2782] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:02 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:03.021194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:03.021809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:03.028364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.028828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:03.029589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.030025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:03.132247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:03.132878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:03.139523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.139967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:03.140719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.141170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:03.161612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:03.169945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f62070f0-ed36-458c-9ae0-49acd45415a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152548 Aug 03 09:59:03.170515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1450/2783] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:03.203996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:03.212123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cff044e-bd61-4446-8be2-300190f845ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083634 Aug 03 09:59:03.212703 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1334/2784] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:03 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:03.973132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:03.973657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:03.980284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.980723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:03.981500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:03.981928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:04.109037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:04.116944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e3ebf224-4a35-4a5b-a7d9-216cc1aaf673 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147724 Aug 03 09:59:04.117508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1451/2785] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:03 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:04.191966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:04.192686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:04.199833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:04.200277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:04.201072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:04.201506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:04.233021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:04.233555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:04.239600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:04.240037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:04.240794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:04.241245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:04.305780 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:04.313818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2fb9e6de-5776-429f-83c1-be9a333fcea8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084705 Aug 03 09:59:04.314386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1452/2786] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:04 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:04.335351 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:04.343679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6e5565d6-d8fe-4612-988a-417fcc5ee5a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155514 Aug 03 09:59:04.344241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1335/2787] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:05.138856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:05.139470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:05.145979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.146428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.147184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.147622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.277334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:05.285342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-95d46812-5207-4164-af32-fc1b6b0ba18e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150890 Aug 03 09:59:05.285928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1453/2788] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:05 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:05.335067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:05.335600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:05.337980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=78 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:05.343387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.343838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.344591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.345051 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.365439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:05.366041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:05.373135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.373579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.374356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:05.374787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:05.408519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:05.417037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d86bd152-3d97-4aed-9277-94acdf0361d3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085493 Aug 03 09:59:05.417602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1336/2789] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:05 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:05.503110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:05.512020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-02341726-43bb-423b-aca4-ffd283c2e164 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150328 Aug 03 09:59:05.512598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1454/2790] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:06.306240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:06.306766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:06.313029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.313466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.314212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.314640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.438346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:06.438963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:06.439533 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:06.441415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=82 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:06.446626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.447075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.448378 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fd0601f4-cd51-44e9-8213-5808e83257f2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.145565 Aug 03 09:59:06.448516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.448910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.449057 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1337/2791] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:06 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:06.513147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:06.521029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ba9828e-0a20-4f4a-a11e-9199ad436610 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087268 Aug 03 09:59:06.521584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1455/2792] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:06 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:06.534712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:06.535317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:06.541277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.541720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.542462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:06.542887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:06.677765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:06.686514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ed0e7a0-01fb-437d-906d-2e13f9b173b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155742 Aug 03 09:59:06.687082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1338/2793] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:07.470010 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:07.470625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:07.477123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.477573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.478329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.478844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.542196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:07.542960 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:07.549276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.549726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.550499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.550931 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.608838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:07.614345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:07.617354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e505102c-5c69-43f5-a479-e1d5311ce2f8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151063 Aug 03 09:59:07.617937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1456/2794] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:07 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:07.622385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45ca3db4-077f-4b7e-90ea-1cf0d48ef8a7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084610 Aug 03 09:59:07.622940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1339/2795] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:07 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:07.708350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:07.708912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:07.715563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.716011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.716765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:07.717230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:07.847357 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:07.855795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-95980167-d183-4479-9c39-f9858cc52233 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151293 Aug 03 09:59:07.856355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1457/2796] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:08.639066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:08.639668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:08.643106 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:08.643724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:08.646380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.646824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:08.647577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.648003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:08.649924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.650380 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:08.652103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.652568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:08.718533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:08.726627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d68991b4-1634-44f6-8315-1b2f46bcfeea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087201 Aug 03 09:59:08.727292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1458/2797] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:08 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:08.778330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:08.786286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-836a7eb6-31bf-436c-ac17-5483ee35417c tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.151764 Aug 03 09:59:08.786849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1340/2798] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:08 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:08.876521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:08.877155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:08.883118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.883567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:08.884312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:08.884743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:09.011875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:09.019758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e42733e4-ec34-4a17-8a68-5a9f6d74bce2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147077 Aug 03 09:59:09.020314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1459/2799] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:09.747814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:09.748353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:09.754829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:09.755276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:09.756029 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:09.756457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:09.807679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:09.808715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:09.821050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:09.821500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:09.822167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:09.822303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:09.823258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:09.831400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e27ed5a-f25a-4166-83fd-66e953a66b10 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087760 Aug 03 09:59:09.831974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1341/2800] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:09 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:09.950745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:09.958833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ae5625a0-bc64-4a52-811d-1ad57585b67a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.155968 Aug 03 09:59:09.959386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1460/2801] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:09 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:10.040530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:10.041086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:10.047619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.048073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:10.048861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.049300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:10.174503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:10.185274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-647b1300-ca60-440e-a593-68106fc3599f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148587 Aug 03 09:59:10.185855 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1342/2802] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:10.851542 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:10.852186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:10.858819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.859268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:10.860026 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.860459 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:10.924682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:10.932755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ae5a2ad-d82c-4898-8313-5a54e202c60d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085115 Aug 03 09:59:10.933347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1461/2803] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:10 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:10.979327 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:10.979934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:10.986509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.986948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:10.987706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:10.988135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:11.116504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:11.124424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b6fba223-6c51-4412-9035-51c2fbb3b13b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148983 Aug 03 09:59:11.125022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1343/2804] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:10 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:11.206619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:11.207287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:11.213230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:11.213684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:11.214441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:11.214868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:11.344531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:11.352394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9965b2d5-b7ec-4cbd-b447-72306ee09838 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149858 Aug 03 09:59:11.352981 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1462/2805] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:11.953269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:11.954158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:11.960105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:11.960544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:11.961316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:11.961761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:12.029231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:12.037055 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae2739bd-45b8-46ab-a2da-d62b7453aeee tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.087747 Aug 03 09:59:12.037605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1344/2806] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:11 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:12.145803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:12.146409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:12.153693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:12.154135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:12.154882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:12.155308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:12.281930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:12.289729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bb848b6c-59a1-4a6e-ab9d-4071ef703ec6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147850 Aug 03 09:59:12.290303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1463/2807] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:12 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:12.374128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:12.374732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:12.380650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:12.381123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:12.381866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:12.382294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:12.511388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:12.519316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-36687a93-ed48-485a-818e-57e329c3197c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149087 Aug 03 09:59:12.519874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1345/2808] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:13.058885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:13.059498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:13.065601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.066047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.066808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.067241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.131454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:13.139519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e242d32-f07d-454e-86e2-b0dc7631ead6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085170 Aug 03 09:59:13.140080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1464/2809] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:13 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:13.311904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:13.312441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:13.318848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.319295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.320037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.320465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.451080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:13.459161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-60546309-495a-4e13-9875-53b67137a3e8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152100 Aug 03 09:59:13.459715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1346/2810] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:13 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:13.541984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:13.542663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:13.549096 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.549548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.550309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:13.550754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:13.682431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:13.691054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6f36427e-6ccb-4fc9-97bd-51644004d369 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153567 Aug 03 09:59:13.692862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1465/2811] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:14.159457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:14.160086 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:14.166104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.167264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.168011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.168437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.228779 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:14.231561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:14.238445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-204d01bf-d693-49e9-961a-c53c5434db48 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082850 Aug 03 09:59:14.239001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1347/2812] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:14 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:14.481566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:14.482204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:14.488447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.488921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.489669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.490115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.492598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:14.618366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:14.626609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b9daf37e-ceae-49ec-8089-75774646b149 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149742 Aug 03 09:59:14.627173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1466/2813] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:14 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:14.711782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:14.712409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:14.719819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.720262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.721035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:14.721464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:14.847410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:14.855587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-21d81755-3661-4499-abdd-2efd2616e329 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147599 Aug 03 09:59:14.856156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1348/2814] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:15.258993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:15.259603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:15.266287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.266732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:15.267484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.267923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:15.331796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:15.339875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d4f9d461-5fa2-45a4-9a31-4f41229dc7e5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084780 Aug 03 09:59:15.340430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1467/2815] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:15 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:15.647250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:15.647858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:15.654740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.655212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:15.655980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.656415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:15.796258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:15.804190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d05eec0a-f316-4ab5-b32a-a768ae4c78d3 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.160902 Aug 03 09:59:15.804751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1349/2816] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:15 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:15.876512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:15.877128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:15.883483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.883921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:15.884664 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:15.885291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:16.018434 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:16.027105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-066052e5-ea02-4bba-8eb9-8b3eef596bcf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154441 Aug 03 09:59:16.027658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1468/2817] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:16.359479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:16.360092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:16.366145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:16.366588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:16.367340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:16.367771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:16.428671 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:16.437512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-67ab631a-74d4-42c2-8dd0-19b7da6e07ea tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081902 Aug 03 09:59:16.438079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1350/2818] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:16 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:16.825932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:16.826454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:16.833288 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:16.833737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:16.834520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:16.834978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:16.961178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:16.969691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c55e339a-e7ae-4003-9d65-f05e7660db11 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148484 Aug 03 09:59:16.970252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1469/2819] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:16 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:17.048402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:17.049251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:17.055865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:17.056318 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:17.057103 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:17.057585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:17.183341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:17.191155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9a1eb4da-8296-4ac4-9ed5-d1e7ce18ec0e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146536 Aug 03 09:59:17.191715 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1351/2820] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:17.459279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:17.459890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:17.466766 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:17.467216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:17.467971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:17.468407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:17.533446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:17.541310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-803b2acc-35c9-47d4-8266-d2129a324fdb tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085932 Aug 03 09:59:17.541872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1470/2821] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:17 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:17.990574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:17.991180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:17.998431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:17.998865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:17.999620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:18.000053 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:18.130605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:18.139624 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2bce9499-49b9-421e-b7c6-ad5b78aa5988 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.152896 Aug 03 09:59:18.140246 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1352/2822] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:17 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:18.212487 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:18.213140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:18.219671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:18.220141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:18.220909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:18.221349 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:18.350861 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:18.359268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1d1b2e2e-2025-4d6f-b613-e09997b231d8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150557 Aug 03 09:59:18.359824 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1471/2823] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:18.561613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:18.562178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:18.568111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:18.568556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:18.569347 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:18.569782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:18.631188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:18.640324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3988c325-5f8d-4ad1-bdf2-f15e21d4fcf4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082980 Aug 03 09:59:18.640906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1353/2824] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:18 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:19.161309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:19.161930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:19.168756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.169368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.170117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.170548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.297270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:19.305167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-578afdf9-eb91-4330-9a17-28245d8dc6a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.147937 Aug 03 09:59:19.305663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1472/2825] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:19 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:19.379494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:19.380092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:19.387545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.387986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.388737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.389188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.519122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:19.527552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b24a73b5-0309-49c5-99b1-e763b2771f35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151898 Aug 03 09:59:19.528117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1354/2826] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:19.662110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:19.662718 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:19.669308 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.669752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.670498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:19.670928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:19.735233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:19.743042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0db017d9-422d-4f09-acae-1fd1c825cd84 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084807 Aug 03 09:59:19.743598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1473/2827] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:19 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:20.327517 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:20.328075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:20.334536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.334978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.335758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.336184 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.469769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:20.477587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cd9e876b-edc1-47a2-9c58-26e6316b56e2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154303 Aug 03 09:59:20.478147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1355/2828] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:20 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:20.548315 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:20.548998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:20.555341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.555784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.556529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.556995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.686764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:20.694516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9f91e149-68ce-49f2-a8ce-b9b874887bd4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150026 Aug 03 09:59:20.695076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1474/2829] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:20.764452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:20.765111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:20.771046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.771490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.772233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:20.772667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:20.833497 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:20.841980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-177ce56f-f29a-4122-b4a7-716c87a0dd44 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082429 Aug 03 09:59:20.842538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1356/2830] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:20 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:21.498898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:21.499511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:21.505522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.505963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.506712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.507145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.634841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:21.642826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6749c82-dafa-4e71-9bbb-60a6f41d918a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148360 Aug 03 09:59:21.643389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1475/2831] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:21 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:21.717555 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:21.718096 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:21.724536 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.725022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.725776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.726209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.852365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:21.860754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce863937-1113-45fb-893c-1aac0dba850e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147600 Aug 03 09:59:21.861356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1357/2832] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:21.863730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:21.864345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:21.870895 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.871340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.872102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:21.872538 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:21.936798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:21.944775 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-df506d05-aa33-4c89-9b26-8c4f81530cd7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085946 Aug 03 09:59:21.945361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1476/2833] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:21 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:22.664348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:22.664985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:22.671140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.671587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:22.672340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.672776 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:22.801291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:22.809907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2db4e5d5-db24-4559-a75b-7033058bf185 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149655 Aug 03 09:59:22.810452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1358/2834] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:22 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:22.880743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:22.881376 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:22.888032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.888478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:22.889260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.889698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:22.966210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:22.966640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:22.972676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.973149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:22.973903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:22.974360 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:23.019080 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:23.027769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2851e6c-c8c7-47ba-869d-2b85c516ae83 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150853 Aug 03 09:59:23.028338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1477/2835] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:23.040927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:23.045982 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fe2e3b93-8ef5-42ea-bce3-785a2a23decf tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084003 Aug 03 09:59:23.046539 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1359/2836] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:22 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:23.830483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:23.831009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:23.837146 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:23.837600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:23.838410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:23.839480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:23.906365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 09:59:23.907064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 09:59:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a (ip 10.222.0.20) !!! Aug 03 09:59:23.972575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:23.981206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b8d91366-9b2d-4adc-961f-bc6fa2123e8f tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.154949 Aug 03 09:59:23.981771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1478/2837] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:23 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:24.050226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:24.050945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:24.057143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:24.057583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:24.058341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:24.058764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:24.066714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:24.067431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:24.073752 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:24.074207 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:24.074961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:24.075392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:24.141515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:24.149605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7472472-782b-4c38-a2cf-370313108126 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086708 Aug 03 09:59:24.150259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1479/2838] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:24 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:24.190498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:24.198701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-193c5626-c772-44a9-bd2a-1ebf60786b35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152540 Aug 03 09:59:24.199262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1360/2839] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:25.001513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:25.002119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:25.008580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.009062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.009847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.010796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.138253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:25.146245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6781ef99-87c6-46b9-baa5-267e7a396ce5 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148581 Aug 03 09:59:25.146811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1480/2840] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:24 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:25.170891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:25.171498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:25.177974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.178414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.179167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.179597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.220377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:25.221021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:25.226965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.227413 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.228171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:25.228605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:25.241290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:25.249218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ead63557-6921-41d5-819a-96b112d7fe11 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082253 Aug 03 09:59:25.249791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1361/2841] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:25 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:25.355609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:25.363491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a2b59dac-2269-43ab-84f0-204178b317b6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147208 Aug 03 09:59:25.364055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1481/2842] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:26.168795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:26.169419 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:26.175917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.176487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.177124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.177551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.270697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:26.271343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:26.278684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.279138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.279909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.280352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.305844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:26.314603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0331ada0-a4cd-465d-a4de-ed81732983d8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.150279 Aug 03 09:59:26.315183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1362/2843] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:26 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:26.347436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:26.349660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:26.357351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-383739e5-752d-48d9-a939-42fbbba69f95 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.090549 Aug 03 09:59:26.357923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1482/2844] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:26 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:26.385782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:26.386409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:26.392364 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.392802 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.393576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:26.394005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:26.526450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:26.534696 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ca57cc9a-8932-4167-9f7f-e01b316a0ec1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153036 Aug 03 09:59:26.535262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1363/2845] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:27.335729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:27.336271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:27.343491 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.343947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.344692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.345152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.378329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:27.378963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:27.385612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.386157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.386785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.387218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.402384 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:27.450188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:27.458494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e8a5058-56f5-4cca-8a81-8fd44f822f7b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084058 Aug 03 09:59:27.459068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1364/2846] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:27 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:27.476471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:27.485127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8d1070d4-d768-4f62-b4c4-4c1f1b9596a7 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.153330 Aug 03 09:59:27.485704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1483/2847] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:27 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:27.556241 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:27.556923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:27.562888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.563338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.564098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:27.564534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:27.691072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:27.699719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7099fe37-4b0e-4d15-8183-be1f92e6d863 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147256 Aug 03 09:59:27.700279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1365/2848] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:28.480631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:28.481290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:28.487761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.488204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.489058 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.489488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.506745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:28.507344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:28.515037 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.515483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.517451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.517920 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.556278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:28.564195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1510d428-8da9-41de-84cf-9e20e38d10c5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.088955 Aug 03 09:59:28.564762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1484/2849] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:28 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:28.652502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:28.660396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9bc153de-dd85-40d4-9361-610d9913be3d tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.157541 Aug 03 09:59:28.660992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1366/2850] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:28 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:28.720671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:28.721304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:28.727182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.727626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.728374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:28.728804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:28.858857 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:28.866742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a8f262ac-a048-41ab-b20c-e46c7ac04c5d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149901 Aug 03 09:59:28.867304 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1485/2851] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:29.585171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:29.585785 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:29.593017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.593466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:29.594226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.594660 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:29.655797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:29.663611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-15bd193a-2971-43a7-8ff3-65775e951c09 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082453 Aug 03 09:59:29.664163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1367/2852] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:29 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:29.681002 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:29.681610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:29.688265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.688636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:29.689412 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.689844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:29.828628 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:29.836536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-10acad44-e816-429e-a176-fddaf106fab4 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.159371 Aug 03 09:59:29.837144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1486/2853] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:29 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:29.889222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:29.889823 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:29.895888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.896330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:29.897107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:29.897532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:30.025576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:30.034247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c3c8c15-a38b-4303-b6fb-28c1103a8b3f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149666 Aug 03 09:59:30.035093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1368/2854] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:30.685204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:30.685817 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:30.692319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:30.692768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:30.693561 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:30.693995 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:30.754497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:30.762392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f4847a90-843f-4cb8-910b-8291deadaf0f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081077 Aug 03 09:59:30.762956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1487/2855] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:30 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:30.858719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:30.859968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:30.866520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:30.866958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:30.867705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:30.868130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:30.996737 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:31.004684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6f37be50-a5ab-4b67-b33f-30df687982c9 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.149882 Aug 03 09:59:31.005290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1369/2856] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:30 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:31.056499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:31.057253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:31.063261 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:31.063713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:31.064475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:31.064945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:31.194983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:31.203700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ebf1fb40-31a3-49c3-a49e-868ce66f29dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150689 Aug 03 09:59:31.204210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1488/2857] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:31.783044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:31.783646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:31.789666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:31.790106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:31.790853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:31.791888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:31.853519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:31.862050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b80a6221-d8a6-4b63-94d6-fcf95b817ba5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082897 Aug 03 09:59:31.862639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1370/2858] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:32.026092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:32.026695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: 9b12ac06-e52e-4590-b8ab-1007b884d39a] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:32.033319 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.033702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.034453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.034883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.161920 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:32.170900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-76a486d6-339d-45bc-a578-8d5fed02f793 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a" status: 200 len: 1558 microversion: 2.1 time: 0.148693 Aug 03 09:59:32.171464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1489/2859] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:32 2022] GET /compute/v2.1/servers/9b12ac06-e52e-4590-b8ab-1007b884d39a => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:32.224458 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:32.225107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:32.232594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.233067 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.233822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.234251 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.362942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:32.371020 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f92d403d-4545-440b-adb4-88f0fd5d476f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150442 Aug 03 09:59:32.371579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1371/2860] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:32.883103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:32.883722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:32.889801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.890251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.891012 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:32.891450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:32.954437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:32.962287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-50fe7b17-b6fa-4a40-ad1c-84c99028f231 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083106 Aug 03 09:59:32.962851 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1490/2861] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:32 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:33.391549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:33.392161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:33.398665 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:33.399112 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:33.399862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:33.400292 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:33.529332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:33.537264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12219d22-9920-4e7b-932f-24be4fa7029d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149654 Aug 03 09:59:33.537825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1372/2862] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:33.984239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:33.984874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:33.991373 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:33.991821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:33.992576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:33.993042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:34.059205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:34.067132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-229b4d02-3413-4a74-80d2-1030140eeda0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086732 Aug 03 09:59:34.067692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1491/2863] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:33 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:34.559414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:34.560060 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:34.566606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:34.567048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:34.567797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:34.568225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:34.693956 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:34.702442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7dfe49fa-c3b9-4ec7-a228-015770f4886f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147429 Aug 03 09:59:34.703008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1373/2864] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:35.087493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:35.088837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:35.095378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:35.095827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:35.096584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:35.097055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:35.158591 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:35.166521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cf523669-2cd4-453f-ad8f-20ef12daedf8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082887 Aug 03 09:59:35.167088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1492/2865] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:35 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:35.723857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:35.724433 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:35.726771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=76 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:35.732962 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:35.733408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:35.734160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:35.734587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:35.872234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:35.880260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6f38f8b8-e15e-437b-ac61-59c4cefc7345 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.160348 Aug 03 09:59:35.880891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1374/2866] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:36.186418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:36.187029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:36.193546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:36.193991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:36.194746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:36.195180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:36.256165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:36.264632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-00a38e2a-d477-42e4-8e69-d850a97bb72c tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082099 Aug 03 09:59:36.265221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1493/2867] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:36 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:36.901980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:36.902585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:36.909123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:36.909562 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:36.910309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:36.910738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:37.037119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:37.045697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d47048de-ab39-4ac0-a85b-0973ebedb9c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147853 Aug 03 09:59:37.046266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1375/2868] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:37.286045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:37.286576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:37.288911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:37.294833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:37.295278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:37.296031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:37.296460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:37.357672 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:37.365517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-86405645-8357-4f34-b621-e3626b850ec4 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083469 Aug 03 09:59:37.366076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1494/2869] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:37 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:38.067509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:38.068115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:38.074790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:38.075232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:38.075986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:38.076416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:38.207285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:38.215440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-925aff4f-5d93-470d-a5d5-69fb6fdf731f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151754 Aug 03 09:59:38.216017 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1376/2870] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:38.386312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:38.386919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:38.393394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:38.393836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:38.394580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:38.395007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:38.458277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:38.467102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-81a7fdc5-bb16-41cb-8eda-3e1d15826d37 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084890 Aug 03 09:59:38.467670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1495/2871] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:38 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:39.237513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:39.238149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:39.244760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:39.245237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:39.246003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:39.246435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:39.375261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:39.383069 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-10f5c7a8-e830-4072-b650-82fdc85f2375 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149479 Aug 03 09:59:39.383634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1377/2872] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:39.488836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:39.489537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:39.496862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:39.497317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:39.498067 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:39.498502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:39.561964 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:39.569704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c0691036-face-4201-a81b-e5570931dc93 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084765 Aug 03 09:59:39.570263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1496/2873] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:39 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:40.404382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:40.405016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:40.411462 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:40.411901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:40.412649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:40.413106 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:40.540784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:40.548526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8dbd16c-c84c-4107-82ce-7f0c27fc7104 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148068 Aug 03 09:59:40.549121 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1378/2874] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:40.590632 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:40.591254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:40.597695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:40.598147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:40.598905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:40.599343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:40.659682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:40.667647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0a214de4-8e6d-433f-9206-ddd21f9d9513 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081052 Aug 03 09:59:40.668206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1497/2875] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:40 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:41.570263 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:41.570989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:41.578453 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:41.578901 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:41.579654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:41.580090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:41.688543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:41.689234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:41.695770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:41.696218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:41.697547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:41.697988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:41.709832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:41.718514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-afaf0d8a-bfe1-4f08-8006-d8854aa411a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152084 Aug 03 09:59:41.719316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1379/2876] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:41.758032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:41.766724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7d85912e-1ec0-4c5b-97fb-223f6fee29dd tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082059 Aug 03 09:59:41.767293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1498/2877] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:41 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:42.739506 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:42.740113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:42.746934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:42.747361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:42.748113 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:42.748547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:42.787342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:42.787977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:42.795642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:42.796093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:42.796885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:42.797323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:42.811986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:42.867724 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:42.876431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-107c12a2-9ab1-42ef-b597-d034958f0324 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.092849 Aug 03 09:59:42.877028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1499/2878] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:42 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:42.880324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:42.889749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b7d65ec6-97cb-4334-8cf3-d8e76b17a320 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154160 Aug 03 09:59:42.890306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1380/2879] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:43.897311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:43.897887 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:43.905087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:43.905536 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:43.906294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:43.906726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:43.911087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:43.911772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:43.918231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:43.918670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:43.919422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:43.919848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:43.922420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 09:59:43.969316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:43.977042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ce909898-9545-402d-947f-46e405c90545 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083541 Aug 03 09:59:43.977602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1500/2880] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:43 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:44.051483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:44.059656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cbe6adb4-32bc-4b6a-b22c-9bfd00509a3a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152380 Aug 03 09:59:44.060230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1381/2881] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:44.998215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:44.998872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:45.004969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:45.005422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:45.006184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:45.006626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:45.067765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:45.075921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dce5394a-4ad4-4c6a-acf7-795a43b894ef tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081736 Aug 03 09:59:45.076484 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1501/2882] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:44 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:45.081553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:45.082183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:45.089245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:45.089682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:45.090428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:45.090854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:45.216577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:45.224424 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6fe9f7b0-0ecf-47c2-91c9-c0879dcbfb82 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146966 Aug 03 09:59:45.225008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1382/2883] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:46.097555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:46.098161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:46.105335 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:46.105772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:46.106517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:46.106943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:46.168178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:46.175907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-192fc29a-9187-4153-a6a1-38e8b6fe35b5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082196 Aug 03 09:59:46.176464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1502/2884] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:46 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:46.247367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:46.247964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:46.254464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:46.254902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:46.255648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:46.256076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:46.381013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:46.389218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c4d6b3c4-2bb6-4635-9fe6-8117fc2a4dcb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146698 Aug 03 09:59:46.389800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1383/2885] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:47.197703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:47.198317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:47.205102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:47.205559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:47.206321 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:47.206761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:47.270489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:47.278410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6976e74b-d221-4ea1-b445-e19e51fa6ac0 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085291 Aug 03 09:59:47.278969 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1503/2886] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:47 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:47.411313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:47.411941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:47.419259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:47.419691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:47.420441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:47.420898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:47.553686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:47.562443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8bf979b8-6d12-43cf-8bf3-1a4a40ab1a4e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155210 Aug 03 09:59:47.563012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1384/2887] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:48.299255 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:48.299855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:48.306688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:48.307078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:48.307905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:48.308339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:48.379348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:48.388865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ed0c80ec-a02c-4358-ae7a-29d3ddeea642 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.092918 Aug 03 09:59:48.388865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1504/2888] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:48 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:48.584532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:48.585128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:48.592882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:48.593324 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:48.594075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:48.594500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:48.730191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:48.738666 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-246064af-4fef-4445-90f9-83922709e359 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.158402 Aug 03 09:59:48.739237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1385/2889] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:49.410077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:49.410691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:49.417603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:49.418051 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:49.418813 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:49.419250 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:49.480771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:49.488645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a9326a04-b993-432a-8db1-e8f3ed229344 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082419 Aug 03 09:59:49.489249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1505/2890] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:49 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:49.760912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:49.761470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:49.767953 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:49.768402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:49.769245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:49.769681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:49.902875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:49.910812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b737b195-0cab-4cb0-94ae-e36e9b41ea65 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154399 Aug 03 09:59:49.911386 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1386/2891] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:50.509949 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:50.510621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:50.517099 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:50.517545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:50.518291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:50.518716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:50.579219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:50.586934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-782884d2-73ce-494a-a360-89a5066c6bc2 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.080868 Aug 03 09:59:50.587495 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1506/2892] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:50 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:50.931470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:50.932623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:50.939348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:50.939795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:50.940550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:50.941023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:51.068343 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:51.077045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5983e0bb-2470-480d-8152-437e91997660 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149446 Aug 03 09:59:51.077864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1387/2893] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:51.607770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:51.608367 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:51.614806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:51.615247 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:51.615990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:51.616421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:51.680642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:51.689183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-29a4a6b2-a48d-4fa2-acd5-e4b6c0b77f1b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085313 Aug 03 09:59:51.689746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1507/2894] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:51 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:52.098046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:52.098657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:52.105389 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:52.105839 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:52.106596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:52.107044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:52.235091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:52.242993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3e35eaa5-e2a1-4c2c-aaef-f5e91d428565 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148824 Aug 03 09:59:52.243564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1388/2895] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:52.710894 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:52.711494 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:52.718137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:52.718587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:52.719345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:52.719783 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:52.781049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:52.788947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-05095765-3d07-4901-a427-e3597f015790 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081983 Aug 03 09:59:52.789514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1508/2896] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:52 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:53.265138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:53.265903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:53.272284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:53.272735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:53.273620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:53.274095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:53.655490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:53.663600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dcff77e7-5135-4a0e-8e13-06d5b16f4080 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.403176 Aug 03 09:59:53.664177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1389/2897] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:53.809573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:53.810105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:53.816533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:53.817011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:53.817763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:53.818192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:53.879451 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:53.888038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2ed4cd75-ffa4-4c61-b74f-9870ec833b2f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082411 Aug 03 09:59:53.888588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1509/2898] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:53 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:54.685388 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:54.685996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:54.692472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:54.693015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:54.693770 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:54.694198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:54.856064 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:54.864198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-17a15e7d-4243-4b8d-930e-16a85ce5cbda tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.183400 Aug 03 09:59:54.864763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1390/2899] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:54.908613 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:54.909269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:54.915741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:54.916208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:54.917091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:54.917521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:54.980694 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:54.988597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2b23063-3111-45ce-9b5e-f47a9e17c0a5 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.083938 Aug 03 09:59:54.989184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1510/2900] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:54 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:55.886695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:55.887266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:55.893706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:55.894149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:55.894899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:55.895332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:56.011197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:56.011826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:56.018216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:56.018657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:56.019405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:56.019831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:56.023751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:56.032202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-79d964a2-6525-4c19-b6b5-6482f3e5cf50 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149956 Aug 03 09:59:56.033006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1391/2901] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:56.083516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:56.092447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5fcf010c-2722-4326-935d-bde0e21f6650 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.086205 Aug 03 09:59:56.093102 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1511/2902] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:56 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:57.053244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:57.053867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:57.061068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:57.061519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:57.062267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:57.062695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:57.113184 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:57.113799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:57.120776 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:57.121258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:57.122029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:57.122473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:57.185622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:57.193799 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b78e8641-6af3-4b8d-b0a1-8fbedba28ec6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084431 Aug 03 09:59:57.194583 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1512/2903] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:57 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:57.198185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:57.206551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9c8e37b0-f959-4d11-8d72-ad0d1f26a9a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.157140 Aug 03 09:59:57.207277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1392/2904] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:58.215830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:58.216439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:58.222952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:58.223424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:58.224177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:58.224608 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:58.227687 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:58.230151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:58.236042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:58.236490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:58.237286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:58.237724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:58.286944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:58.295990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a227806b-bc30-4d76-9d63-db3062e7afda tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.084385 Aug 03 09:59:58.296764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1513/2905] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:58 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:58.365936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:58.374132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d3de3ca7-7939-4cf6-8cad-89dc96f17969 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150545 Aug 03 09:59:58.374692 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1393/2906] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 09:59:59.317849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:59.318418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:59.325562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:59.326007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:59.326754 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:59.327185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:59.387229 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:59.395079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f5e73941-e66d-4af0-9ccd-7f370022fe43 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.081166 Aug 03 09:59:59.395507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 09:59:59.395954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1514/2907] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:59 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 09:59:59.396352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 09:59:59.403040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:59.403581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:59.404412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 09:59:59.404941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 09:59:59.531748 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 09:59:59.539628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bcaeef8b-28f0-4f6f-8b5c-059883732000 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148086 Aug 03 09:59:59.540192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1394/2908] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 09:59:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:00.415526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:00.416122 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:00.422621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:00.423066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:00.423821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:00.424254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:00.488747 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:00.496688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-68c12cc2-0a30-4f5d-b924-774687f0472a tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.085048 Aug 03 10:00:00.497271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1515/2909] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:00 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:00.561460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:00.562128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:00.568582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:00.569059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:00.569844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:00.570278 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:00.705014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:00.713526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dbbe4f6a-d994-441c-953c-8ea771bc9427 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155315 Aug 03 10:00:00.714093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1395/2910] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:01.517124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:01.517731 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:01.524162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:01.524605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:01.525385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:01.525811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:01.528305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:01.587962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:01.595973 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-75086c74-9ded-4c12-9620-3365fefd5e15 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 200 len: 1369 microversion: 2.1 time: 0.082795 Aug 03 10:00:01.596537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1516/2911] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:01 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:01.616512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-694e53fd-b167-47a4-86ae-a27fe98d09e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '.version_select at 0x7fb998a63670>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:01.639650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-694e53fd-b167-47a4-86ae-a27fe98d09e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655844225" status: 202 len: 0 microversion: 2.1 time: 0.026926 Aug 03 10:00:01.640211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1396/2912] 10.222.0.20 () {58 vars in 1221 bytes} [Wed Aug 3 10:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655844225 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:00:01.735604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:01.736223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:01.742290 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:01.742886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:01.743515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:01.744689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:02.209865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:02.218512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7adf50f2-66a4-48ae-9d3d-9c0b0b6ef623 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.486928 Aug 03 10:00:02.219097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1517/2913] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:02.668872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9725a303-3a12-498f-a098-f433671dd289 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'create', calling method: .version_select at 0x7fb998a89670>, body: {"keypair": {"name": "tempest-keypair-604405953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDNQhrnpA/7R5LVQ7qIwPP2+fWWYerzMrVXDSXndlNaj2n5PWJUM073WregXYlMD0EsZ92XJUNJ/c0Ho5QmATC39cVaijl643mt5P7PwBgjKXuMC6tj3t77V8eZCkUwEw=="}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:00:02.686856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-9725a303-3a12-498f-a098-f433671dd289 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for project 0e293737b69a41e79fdcdbb99baca498. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:00:02.691477 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-9725a303-3a12-498f-a098-f433671dd289 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for user 29203ff4c61c48fd940e6ac6c51e5fea and project 0e293737b69a41e79fdcdbb99baca498. Resources: {'key_pairs'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:00:02.717807 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9725a303-3a12-498f-a098-f433671dd289 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054189 Aug 03 10:00:02.718781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1397/2914] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 10:00:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:00:03.240348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:03.241030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:03.247643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:03.248088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:03.248866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:03.249302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:03.383083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:03.391994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-acc7d130-583e-4385-9000-910e88c8b061 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155494 Aug 03 10:00:03.392575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1518/2915] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:03.938233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-357062361", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7547450-fb93-4015-9252-8a4639c271bc"}], "security_groups": [{"name": "tempest-securitygroup--228013420"}], "key_name": "tempest-keypair-604405953", "user_data": "}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:00:04.043795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] validate_networks() for [('f7547450-fb93-4015-9252-8a4639c271bc', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:00:04.413231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:04.414086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:04.421662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:04.422117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:04.422884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:04.423325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:04.465888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:00:04.466312 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:00:04.466810 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:00:04.467222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:00:04.467632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:00:04.476387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:04.476857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:04.477655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:04.478151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:04.497938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for project 0e293737b69a41e79fdcdbb99baca498. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:00:04.503227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Getting quotas for user 29203ff4c61c48fd940e6ac6c51e5fea and project 0e293737b69a41e79fdcdbb99baca498. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:00:04.515367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:00:04.517856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:00:04.570897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:04.575880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-51a589e5-eb1e-478a-b971-001a9ad0a050 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.642367 Aug 03 10:00:04.576540 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1398/2916] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 10:00:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:00:04.582533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3052db6c-e0be-49a8-98bb-e3cc64cb0fd2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.171270 Aug 03 10:00:04.582533 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1519/2917] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:04.592118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87f2d97d-d0ed-429b-8ae5-feaed164b5e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:04.592720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87f2d97d-d0ed-429b-8ae5-feaed164b5e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:04.652802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87f2d97d-d0ed-429b-8ae5-feaed164b5e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:04.660514 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87f2d97d-d0ed-429b-8ae5-feaed164b5e7 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1236 microversion: 2.1 time: 0.072571 Aug 03 10:00:04.661109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1520/2918] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:04 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:05.603701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:05.604572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:05.611699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:05.612229 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:05.613084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:05.613661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:05.681433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:05.682453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:05.701274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:05.701726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:05.702821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:05.703202 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:05.766997 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:05.775805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-408ce97f-77fd-490a-bda6-6b9bba90e506 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1294 microversion: 2.1 time: 0.098038 Aug 03 10:00:05.776378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1521/2919] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:05 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:05.795491 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:05.803450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f2993e19-ca1c-4dcc-b73e-c52f7d844c46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.205096 Aug 03 10:00:05.804079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1399/2920] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:06.797193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:06.797866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:06.804339 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:06.804795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:06.805589 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:06.806576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:06.826753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:06.828073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:06.833297 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:06.835786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:06.836265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:06.837341 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:06.838011 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:06.854675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:06.944993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:06.954158 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-556c1602-84d3-4291-8f4e-7fabb69cc5df tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.160789 Aug 03 10:00:06.955132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1522/2921] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:06 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:07.001436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-25410308-7cf7-4eab-acf3-1ab870079e14 req-8c7ad6de-c4a6-46d1-8286-9aa7331031a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f475884b-478f-4865-ac70-b075342e5bfa", "tag": "2d3f4432-4c10-438a-be0c-bb140faf08c8"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:00:07.011758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-25410308-7cf7-4eab-acf3-1ab870079e14 req-8c7ad6de-c4a6-46d1-8286-9aa7331031a6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:07.012199 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-25410308-7cf7-4eab-acf3-1ab870079e14 req-8c7ad6de-c4a6-46d1-8286-9aa7331031a6 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:07.023123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-25410308-7cf7-4eab-acf3-1ab870079e14 req-8c7ad6de-c4a6-46d1-8286-9aa7331031a6 service nova] Creating event network-changed:2d3f4432-4c10-438a-be0c-bb140faf08c8 for instance f475884b-478f-4865-ac70-b075342e5bfa on hv-cinder-84456 Aug 03 10:00:07.029294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-25410308-7cf7-4eab-acf3-1ab870079e14 req-8c7ad6de-c4a6-46d1-8286-9aa7331031a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031510 Aug 03 10:00:07.029921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1523/2922] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:00:07.078713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:07.086977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-644e2752-5932-4def-9206-50346693b588 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.263996 Aug 03 10:00:07.088072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1400/2923] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:07.976028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:07.976728 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:07.979179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=62 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:07.984549 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:07.985027 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:07.985782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:07.986216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:08.108874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:08.109484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:08.115877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:08.116321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:08.116782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:08.117104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:08.117534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:08.126387 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a8e5f685-0a5d-4e3c-9347-86e3b3c90f33 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.155059 Aug 03 10:00:08.126962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1524/2924] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:07 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:08.279655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:08.287689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cb338c8-c706-4f1b-a2ee-6278b90b4703 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.182662 Aug 03 10:00:08.288257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1401/2925] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:09.148198 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:09.148855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:09.155984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:09.156416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:09.157236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:09.157673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:09.292079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:09.299477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-903ece9c-c1b7-463c-a448-8a6a4fdd9f02 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.155130 Aug 03 10:00:09.300073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1525/2926] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:09 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:09.309256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:09.309797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:09.316766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:09.317250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:09.318009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:09.318442 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:09.450915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:09.460160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-45e0d237-1ac4-4a13-9a05-ca8e3cc71037 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155146 Aug 03 10:00:09.460736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1402/2927] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:10.319658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:10.320248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:10.327358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:10.327807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:10.328566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:10.329042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:10.456914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:10.464882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-318afbf3-9a42-4aa9-9485-1be9f6901870 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.149229 Aug 03 10:00:10.465442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1526/2928] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:10 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:10.483166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:10.483783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:10.490253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:10.490707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:10.491465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:10.491904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:10.620467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:10.628296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ee5ed6ca-92b4-4580-8e0c-0b2ee16d2d95 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148982 Aug 03 10:00:10.628879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1403/2929] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:11.423651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-60831079-d037-46de-85a2-bed9b06c4059 req-68653fbd-f93b-4d04-965a-2eea0c865c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f475884b-478f-4865-ac70-b075342e5bfa", "name": "network-vif-plugged", "status": "completed", "tag": "2d3f4432-4c10-438a-be0c-bb140faf08c8"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:00:11.436535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-60831079-d037-46de-85a2-bed9b06c4059 req-68653fbd-f93b-4d04-965a-2eea0c865c5a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:11.437431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-60831079-d037-46de-85a2-bed9b06c4059 req-68653fbd-f93b-4d04-965a-2eea0c865c5a service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:11.449337 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-60831079-d037-46de-85a2-bed9b06c4059 req-68653fbd-f93b-4d04-965a-2eea0c865c5a service nova] Creating event network-vif-plugged:2d3f4432-4c10-438a-be0c-bb140faf08c8 for instance f475884b-478f-4865-ac70-b075342e5bfa on hv-cinder-84456 Aug 03 10:00:11.454744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-60831079-d037-46de-85a2-bed9b06c4059 req-68653fbd-f93b-4d04-965a-2eea0c865c5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034791 Aug 03 10:00:11.456270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1527/2930] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:00:11.486461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:11.487054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:11.494115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:11.494588 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:11.495376 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:11.495825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:11.651090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:11.651870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:11.658446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:11.658690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:11.659071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:11.659916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:11.660558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:11.666626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93bc04fe-d75e-4e2e-8b3d-1619a441075d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.184151 Aug 03 10:00:11.667199 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1404/2931] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:11 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:11.802408 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:11.811113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de7fccf7-5148-4735-a034-15ce9c1a8944 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.165111 Aug 03 10:00:11.811680 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1528/2932] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:12.687580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:12.688209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:12.694719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:12.695168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:12.695921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:12.696695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:12.832351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:12.833042 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:12.837991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:12.839837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:12.840284 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:12.841066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:12.841498 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:12.845436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9933e5f-c8fb-460f-bf1f-ba972aa5d3fe tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1361 microversion: 2.1 time: 0.161689 Aug 03 10:00:12.846008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1405/2933] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:12 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:12.974577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:12.982528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-82a45442-7a0c-45db-851f-b137f2ce6e00 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154603 Aug 03 10:00:12.983091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1529/2934] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:13.866608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:13.867836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:13.875294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:13.875735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:13.876495 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:13.876959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:14.003713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:14.004435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:14.008732 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:14.014759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:14.015213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:14.015978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:14.016411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:14.016880 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-38280bf6-2b2d-4d62-bd33-a11501811c51 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1546 microversion: 2.1 time: 0.154080 Aug 03 10:00:14.017783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1406/2935] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:13 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:14.037377 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:14.037863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:14.044593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:14.045072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:14.045835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:14.046264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:14.138996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-54b65d2b-6ae6-429f-97c6-1f7b766483e8 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105382 Aug 03 10:00:14.139661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1407/2936] 10.222.0.20 () {58 vars in 1275 bytes} [Wed Aug 3 10:00:14 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:00:14.171510 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:14.179519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-540f0f4f-07c8-4e01-ae8c-fdc91e6a3a69 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.179736 Aug 03 10:00:14.180092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1530/2937] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:15.198668 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:15.199440 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=10 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:15.204141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:15.204754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:15.212344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:15.212832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:15.213789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:15.214224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:15.371162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-debbab37-d3d9-4aaa-be35-fde068edafce req-c36cf521-e8b3-485b-80af-083c2ed3f665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f475884b-478f-4865-ac70-b075342e5bfa", "tag": "2d3f4432-4c10-438a-be0c-bb140faf08c8"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:00:15.380028 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:15.383374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-debbab37-d3d9-4aaa-be35-fde068edafce req-c36cf521-e8b3-485b-80af-083c2ed3f665 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:15.383971 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-debbab37-d3d9-4aaa-be35-fde068edafce req-c36cf521-e8b3-485b-80af-083c2ed3f665 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:15.393842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:15.396274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-debbab37-d3d9-4aaa-be35-fde068edafce req-c36cf521-e8b3-485b-80af-083c2ed3f665 service nova] Creating event network-changed:2d3f4432-4c10-438a-be0c-bb140faf08c8 for instance f475884b-478f-4865-ac70-b075342e5bfa on hv-cinder-84456 Aug 03 10:00:15.402336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-debbab37-d3d9-4aaa-be35-fde068edafce req-c36cf521-e8b3-485b-80af-083c2ed3f665 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035290 Aug 03 10:00:15.402516 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ad93d67-a987-41c2-ae68-4fa7838a6554 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.204372 Aug 03 10:00:15.402974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1531/2938] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:00:15.410643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1408/2939] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:16.424212 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:16.424947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:16.431840 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:16.432283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:16.433064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:16.433497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:16.565472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:16.573271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-71040778-8a32-4657-8545-3977118df011 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153227 Aug 03 10:00:16.573821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1532/2940] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:17.595077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:17.595689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:17.602361 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:17.602861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:17.603626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:17.604062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:17.731590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:17.739528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4ae503a-3314-426c-af8a-ef80018efa05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148313 Aug 03 10:00:17.740084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1409/2941] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:18.761769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:18.762372 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:18.768983 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:18.769429 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:18.770183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:18.770609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:18.897001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:18.905390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b57ed59d-a780-4e45-bcc8-9e0ba50dc9cf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147496 Aug 03 10:00:18.905946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1533/2942] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:19.926485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:19.927091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:19.934267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:19.934713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:19.935465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:19.935899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:20.069967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:20.078576 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c6fce783-13ed-4daa-9d5c-ecf8f1f67c7b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156029 Aug 03 10:00:20.079145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1410/2943] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:21.100668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:21.101305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:21.108520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:21.109008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:21.109765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:21.110203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:21.240726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:21.249208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8acfa6fe-4a55-442b-acdf-4831818116b3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152480 Aug 03 10:00:21.249772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1534/2944] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:22.269811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:22.270474 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:22.277587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:22.278028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:22.278782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:22.279216 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:22.405210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:22.413032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-316e576c-3379-436b-af05-5af34214244e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147096 Aug 03 10:00:22.413593 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1411/2945] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:23.435209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:23.435815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:23.442292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:23.442737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:23.443482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:23.443913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:23.573870 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:23.576120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=100 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:23.583458 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-018dd38a-3a82-4b71-b3c8-349c70fda673 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152639 Aug 03 10:00:23.584036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1535/2946] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:24.606016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:24.606637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:24.612892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:24.613339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:24.614123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:24.614560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:24.745480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:24.753337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-89fcd71b-b291-493d-927e-651b27d7b8cd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151815 Aug 03 10:00:24.753913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1412/2947] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:25.775073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:25.775633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:25.782416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:25.782856 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:25.783911 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:25.784382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:25.912341 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:25.921269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7a09f3bf-e2d6-4f06-85e9-d442105f5be3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150219 Aug 03 10:00:25.921832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1536/2948] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:26.942460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:26.943072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:26.950493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:26.950942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:26.951959 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:26.952394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:27.082007 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:27.090307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a34118a3-91de-45a8-a753-dd9f6197624e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151771 Aug 03 10:00:27.090877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1413/2949] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:28.111770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:28.112369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:28.119577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:28.120016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:28.120764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:28.121217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:28.252090 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:28.260347 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-893fbf6d-0489-4ba6-83b3-8d9a6edf620b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152514 Aug 03 10:00:28.260984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1537/2950] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:29.281552 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:29.282139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:29.288531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:29.289010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:29.289838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:29.290273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:29.417691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:29.425584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-695c2d6f-b8b6-42ee-a68f-a7aa182fa560 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147895 Aug 03 10:00:29.426138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1414/2951] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:30.447181 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:30.447786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:30.454568 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:30.455013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:30.455768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:30.456203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:30.661118 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:30.669673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2d68a352-239c-4161-b978-551f54cc9edb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.226882 Aug 03 10:00:30.670234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1538/2952] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:31.690014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:31.690565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:31.697661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:31.698110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:31.698865 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:31.699299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:31.831531 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:31.839753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3a8fb998-ef00-4744-97c2-2701eeae3ba0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153712 Aug 03 10:00:31.840329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1415/2953] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:32.861257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:32.861858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:32.868475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:32.868944 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:32.869693 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:32.870123 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:33.005318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:33.014196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-2f58a69b-4586-4514-aef2-8b7c80843040 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156861 Aug 03 10:00:33.014758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1539/2954] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:34.035896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:34.036499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:34.043556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:34.043997 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:34.044742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:34.045194 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:34.176783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:34.184804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0271f3db-82c4-48a6-964e-6bf8a4f1aebd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152723 Aug 03 10:00:34.185467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1416/2955] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:35.079190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:00:35.079643 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:00:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:00:35.207144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:35.207751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:35.215108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:35.215556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:35.216312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:35.216743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:35.349418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:35.358244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8c811ef5-0d24-49fa-83da-0de63d47dd43 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154908 Aug 03 10:00:35.358803 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1540/2956] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:36.379559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:36.380170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:36.390296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:36.390747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:36.391527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:36.391966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:36.419568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=100 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:36.573476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:36.582098 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a05b1ea3-617c-4573-a51c-1b8fe1f38a35 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.206389 Aug 03 10:00:36.583223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1417/2957] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:37.604903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:37.605490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:37.614282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:37.614736 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:37.615524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:37.615958 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:37.760069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:37.767928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4d6e213a-45c8-4e8c-964f-4dc395ff00bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.167785 Aug 03 10:00:37.768497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1541/2958] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:38.790571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:38.791203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:38.793632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=36 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:38.799040 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:38.799482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:38.800234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:38.800662 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:38.927340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:38.935950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-fba31166-a7b9-4eca-8427-beeaa37817f1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150561 Aug 03 10:00:38.936513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1418/2959] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:39.957334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:39.958075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:39.960361 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=36 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:39.966839 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:39.967289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:39.968049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:39.968483 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:40.110190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:40.118016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d7ba125f-220d-43b9-81f7-b4410cf9988d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.164635 Aug 03 10:00:40.118588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1542/2960] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:40.598727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:00:40.598924 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:00:41.139838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:41.140441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:41.149476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:41.150220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:41.151996 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:41.152738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:41.295222 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:41.303243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25ea6434-8827-4149-9377-eb26b7480d18 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.167608 Aug 03 10:00:41.303813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1419/2961] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:42.323746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:42.324400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:42.331148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:42.331590 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:42.332378 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:42.332837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:42.465180 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:42.473048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-501a4002-3426-4b31-84bb-78c8a95520ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153385 Aug 03 10:00:42.473611 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1543/2962] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:43.495466 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:43.496075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:43.502677 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:43.503125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:43.503877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:43.504310 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:43.633227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:43.641975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-47b3d429-d81b-4dc6-a364-566770c6cbc3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150427 Aug 03 10:00:43.642541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1420/2963] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:44.663695 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:44.664294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:44.671243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:44.671688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:44.672462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:44.672921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:44.804748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:44.816074 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cb8395c3-235f-4be1-8b11-55240385d0f3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156180 Aug 03 10:00:44.816649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1544/2964] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:45.838824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:45.839370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:45.846652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:45.847101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:45.847863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:45.848329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:45.977100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:45.985974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8c971fe3-8400-467f-8ebd-36162de84c6b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151107 Aug 03 10:00:45.986538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1421/2965] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:47.007354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:47.007975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:47.016024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:47.016463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:47.017254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:47.017698 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:47.145897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:47.154366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ec432c6-e345-4c46-868a-941379994110 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150892 Aug 03 10:00:47.154930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1545/2966] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:48.176074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:48.176690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:48.183762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:48.184205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:48.184995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:48.185427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:48.314815 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:48.322728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9725a0eb-869b-400d-ac1f-fc722638b2f8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150552 Aug 03 10:00:48.323326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1422/2967] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:49.344687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:49.345270 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:49.351762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:49.352204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:49.352977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:49.353410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:49.483033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:49.490892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-12d80d16-e9e6-45cb-9d2b-5540dad89caa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150147 Aug 03 10:00:49.491453 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1546/2968] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:50.513185 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:50.513793 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:50.522781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:50.523235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:50.524013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:50.524445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:50.681314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:50.689373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2d3cc91b-ade5-4aee-a119-4f586b34e132 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.180228 Aug 03 10:00:50.689950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1423/2969] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:51.496652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:51.497175 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:51.504050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:51.504504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:51.505300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:51.505743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:51.530037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-53a5c964-183f-4f33-a272-4db1efd79f04 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa/ips" status: 200 len: 145 microversion: 2.1 time: 0.037989 Aug 03 10:00:51.530602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1547/2970] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 10:00:51 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:00:51.711014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:51.711657 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:51.718801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:51.719247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:51.720009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:51.720441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:51.851091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:51.859572 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9fac27f3-731f-4e22-be53-582abcf479e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152398 Aug 03 10:00:51.860159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1424/2971] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:52.881521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:52.882197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:52.888966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:52.889422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:52.890183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:52.890622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:53.020518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:53.029395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-58aa1936-01a7-46e3-9e7d-2dc449a32ce6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151764 Aug 03 10:00:53.029963 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1548/2972] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:54.051420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:54.052013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:54.059470 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:54.059915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:54.060682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:54.061149 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:54.199645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:54.207991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-eb4f1e60-ea64-448c-966e-91664f11e35d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.160670 Aug 03 10:00:54.208571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1425/2973] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:55.230569 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:55.231171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:55.237769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:55.238213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:55.238952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:55.239384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:55.241902 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:00:55.368369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:55.376554 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7a7bd75-0900-44b4-81b3-271772ee42a1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150509 Aug 03 10:00:55.377165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1549/2974] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:00:56.398243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:56.398882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:56.406431 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:56.406879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:56.407637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:56.408077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:56.542218 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:56.550258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-abea2bfa-b7ea-4654-9317-01539c20d8a8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155899 Aug 03 10:00:56.550850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1426/2975] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:57.571756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:57.572364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:57.579388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:57.579835 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:57.580584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:57.581048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:57.712248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:57.720243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e4737d28-6f54-40fb-b195-7779f74bc587 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152339 Aug 03 10:00:57.720836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1550/2976] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:58.741886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:58.742496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:58.749612 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:58.750052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:58.750837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:58.751265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:58.877167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:00:58.885044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9ae9673-8454-446c-a8a8-818292f6c2f5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146936 Aug 03 10:00:58.885656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1427/2977] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:00:59.906265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:00:59.906875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:00:59.913470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:59.913919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:00:59.914671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:00:59.915105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:00.044901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:00.053025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e00f315-07f5-4dc7-b93c-3adccaa734e4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150600 Aug 03 10:01:00.053595 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1551/2978] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:00:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:01.074766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:01.075367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:01.082410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:01.082846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:01.083590 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:01.084015 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:01.211114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:01.219052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5a00dc20-a867-428f-bfab-c542def1e0b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148793 Aug 03 10:01:01.219608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1428/2979] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:02.241518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:02.242128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:02.249259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:02.249700 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:02.250447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:02.250875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:02.382351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:02.390369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4473f036-4873-4ed9-8d0d-419752213030 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152654 Aug 03 10:01:02.391258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1552/2980] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:02.746353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:01:02.746830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:01:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:01:03.411833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:03.412457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:03.419125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:03.419568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:03.420322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:03.420755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:03.552761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:03.561276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d8ef7f47-8508-4eb7-adf0-fa4f6684865c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153318 Aug 03 10:01:03.561842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1429/2981] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:04.582269 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:04.582906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:04.589566 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:04.590015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:04.590763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:04.591195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:04.722682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:04.731244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3a4a0230-2ae5-40c8-bfc3-285dee83368a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152816 Aug 03 10:01:04.731816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1553/2982] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:05.752904 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:05.753519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:05.760465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:05.760940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:05.761701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:05.762137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:05.889751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:05.897646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dcfe518b-f5a3-4d87-831a-fa1cb97e3eed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148776 Aug 03 10:01:05.898213 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1430/2983] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:06.919746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:06.920312 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:06.926822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:06.927282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:06.928045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:06.928624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:07.055280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:07.064133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cac8cdca-f1bb-4a88-9380-18401a44e335 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149014 Aug 03 10:01:07.064702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1554/2984] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:08.086168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:08.086772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:08.093906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:08.094348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:08.095091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:08.095522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:08.099368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=82 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:08.229219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:08.237307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0c3cb8a7-bc76-46d1-97b1-918f723af182 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154976 Aug 03 10:01:08.237881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1431/2985] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:09.258990 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:09.259596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:09.266675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:09.267153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:09.267903 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:09.268334 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:09.398019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:09.406032 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e2131c63-ae87-48f7-8b4a-2177e61f73eb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150934 Aug 03 10:01:09.406586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1555/2986] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:10.427404 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:10.428088 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:10.430422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=28 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:10.436636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:10.437107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:10.437866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:10.438296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:10.566824 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:10.574854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-727b4711-5408-440c-9bb7-f28a00125421 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151474 Aug 03 10:01:10.575679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1432/2987] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:11.596385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:11.597024 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:11.599352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=28 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:11.604669 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:11.605690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:11.606438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:11.606869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:11.736381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:11.744296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a5586fce-52cf-4fdd-bb6b-bb3127538194 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151772 Aug 03 10:01:11.744873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1556/2988] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:12.766380 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:12.767001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:12.773720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:12.774164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:12.774910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:12.775336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:12.905882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:12.913713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4c94988b-5521-42ff-9eb2-649b73a3bdf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151588 Aug 03 10:01:12.914276 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1433/2989] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:13.936409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:13.937061 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:13.943546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:13.943996 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:13.944755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:13.945214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:14.077326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:14.085170 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-014f59be-aaae-4c0f-9104-f62faf5a280b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153154 Aug 03 10:01:14.085741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1557/2990] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:15.106329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:15.106976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:15.113463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:15.113913 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:15.114667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:15.115104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:15.245778 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:15.253650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-34c9ca88-9bca-4051-890f-c4f377e9cc92 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151309 Aug 03 10:01:15.254223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1434/2991] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:16.275702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:16.277128 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:16.283149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:16.283598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:16.284350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:16.284781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:16.411571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:16.419465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-479c5753-815f-40b3-8e3b-a5b63327eb40 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147874 Aug 03 10:01:16.420036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1558/2992] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:17.440757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:17.441402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:17.447781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:17.448220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:17.448990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:17.450034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:17.578006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:17.585900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-93c0c60c-e282-496b-b1b1-56b1a7e10822 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149027 Aug 03 10:01:17.586472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1435/2993] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:18.608034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:18.608645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:18.615907 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:18.616353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:18.617134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:18.617562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:18.745107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:18.753501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bdd8926b-1d22-4e1c-ae71-194b43f45bfb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149951 Aug 03 10:01:18.754079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1559/2994] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:19.774818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:19.775394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:19.781928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:19.782367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:19.783122 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:19.783553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:19.920794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:19.929257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0b595548-0933-4400-90cc-ccdad7ed7227 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.158272 Aug 03 10:01:19.929844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1436/2995] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:01:20.950662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:20.951282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:20.957692 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:20.958131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:20.958872 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:20.959297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:21.092237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:21.100486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e46c0b1f-3983-440e-b488-9e5f1c544c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153930 Aug 03 10:01:21.101076 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1560/2996] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:22.122150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:22.122761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:22.129781 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:22.130224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:22.130977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:22.131410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:22.260600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:22.268591 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4e0bef58-22c1-44cc-8814-f19ae029f9c1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150376 Aug 03 10:01:22.269201 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1437/2997] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:23.289258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:23.289865 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:23.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:23.297564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:23.298322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:23.298755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:23.426394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:23.434179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-247fb207-8c30-4ec9-a593-ecd6f8dfae20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148831 Aug 03 10:01:23.434733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1561/2998] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:24.456339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:24.457002 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:24.463332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:24.463784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:24.464537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:24.465013 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:24.593406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:24.601307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0261e13e-5df5-4b9f-b5f8-6cff9216c97c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148907 Aug 03 10:01:24.601876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1438/2999] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:25.622966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:25.623594 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:25.630394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:25.630846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:25.631610 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:25.632045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:25.634619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:25.766015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:25.773972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-a322ea91-6b39-4b2a-8f13-e1dbe4a996d9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154932 Aug 03 10:01:25.774532 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1562/3000] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:26.795544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:26.796879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:26.803363 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:26.803804 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:26.804556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:26.805023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:26.931979 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:26.940670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-81d158ce-f1a6-4f3e-9970-a2c95356f84f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149054 Aug 03 10:01:26.941256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1439/3001] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:27.962013 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:27.962639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:27.969248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:27.969699 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:27.970460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:27.970898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:28.098709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:28.106636 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b51648d2-9d48-40c5-83f6-3cc0989a6895 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148467 Aug 03 10:01:28.107197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1563/3002] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:29.127526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:29.128132 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:29.134629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:29.135079 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:29.135838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:29.136275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:29.264337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:29.272963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-318f1c45-6a48-4940-a6f4-d7b64da3a1a2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149372 Aug 03 10:01:29.273522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1440/3003] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:30.294716 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:30.295265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:30.302602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:30.303050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:30.303800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:30.304230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:30.435463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:30.443437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c27533e3-68ea-4faa-923e-fa20f60b696b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152676 Aug 03 10:01:30.443989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1564/3004] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:31.464968 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:31.465602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:31.472138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:31.472574 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:31.473352 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:31.473777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:31.664608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:31.673353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-471d0775-1ad3-49b3-af98-b6e565e3f7bd tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.212229 Aug 03 10:01:31.673924 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1441/3005] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:32.695369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:32.696003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:32.702937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:32.703381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:32.704143 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:32.704576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:32.834519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:32.843156 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-75342c57-9691-4ebb-8b90-d3d847530b70 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151008 Aug 03 10:01:32.843772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1565/3006] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:33.865655 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:33.866349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:33.873641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:33.874164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:33.874963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:33.875441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:34.005150 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:34.013022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ab16b97-eaa3-490f-ba52-474a9d7cbbbc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151771 Aug 03 10:01:34.013587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1442/3007] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:35.035162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:35.035812 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:35.042746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:35.043210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:35.044017 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:35.044470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:35.194140 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:35.203057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc2eef27-6153-4d6b-bdbd-4ddee57f0731 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.171836 Aug 03 10:01:35.203623 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1566/3008] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:36.225277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:36.225892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:36.232513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:36.233656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:36.234422 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:36.234860 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:36.367147 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:36.375146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b4e2e298-ee0f-45ac-bd26-35305994c7aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153757 Aug 03 10:01:36.375719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1443/3009] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:37.396253 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:37.396884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:37.403365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:37.403819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:37.404581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:37.405085 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:37.542828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:37.551733 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-671ed5f1-c550-417b-af80-d69c2507722f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.159298 Aug 03 10:01:37.552324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1567/3010] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:38.572764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:38.573402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:38.580886 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:38.581339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:38.582101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:38.582537 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:38.585193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=78 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:38.714287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:38.722405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d4a1d1b-cd0a-4c43-9e98-5d02c23b7a26 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153472 Aug 03 10:01:38.722972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1444/3011] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:39.744598 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:39.745263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:39.752467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:39.752874 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:39.753633 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:39.754062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:39.893648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:39.901607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-4a7d017f-1713-4b89-ac8b-0887659a5c0a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.160843 Aug 03 10:01:39.902182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1568/3012] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:40.923183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:40.923789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:40.926119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:40.931365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:40.931808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:40.932561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:40.933027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:41.065162 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:41.073062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7801f1bb-1daa-452c-8a2f-6a61b1bf8bd1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153824 Aug 03 10:01:41.073632 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1445/3013] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:42.095998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:42.096604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:42.099059 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=26 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:42.104291 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:42.104745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:42.105526 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:42.105957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:42.239927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:42.247869 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7a1a9a8f-b4ff-4c56-a379-6761bff636aa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156855 Aug 03 10:01:42.248425 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1569/3014] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:43.270566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:43.271160 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:43.277817 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:43.278262 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:43.279016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:43.279446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:43.418178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:43.427058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-108fb133-1eb4-4169-8dbb-4def36e1a37f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.160933 Aug 03 10:01:43.427623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1446/3015] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:44.448959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:44.449889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:44.457105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:44.457557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:44.458353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:44.458789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:44.599254 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:44.607221 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bc964c4c-39b6-4f5d-b566-7f711df117be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.162413 Aug 03 10:01:44.607798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1570/3016] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:45.629180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:45.629813 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:45.636527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:45.637019 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:45.637786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:45.638212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:45.769035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:45.776970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5cfa4d25-9eea-41d3-8674-3788dd66f1b0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152390 Aug 03 10:01:45.777538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1447/3017] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:46.798702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:46.799815 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:46.806501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:46.806933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:46.807689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:46.808124 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:46.936802 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:46.945742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b59a78f1-ea70-42b6-9682-dcc8a501fd11 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150937 Aug 03 10:01:46.946352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1571/3018] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:47.968059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:47.968726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:47.975787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:47.976243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:47.977082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:47.977538 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:48.109945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:48.118145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-67553f44-2f91-4f7a-b598-b4521af1a955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154169 Aug 03 10:01:48.118693 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1448/3019] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:49.140448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:49.141126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:49.148428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:49.148906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:49.149655 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:49.150086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:49.284753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:49.292681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af873594-71ed-4671-989f-d27b711ded8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156204 Aug 03 10:01:49.293283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1572/3020] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:50.313780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:50.314379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:50.321561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:50.322006 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:50.322760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:50.323191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:50.451189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:50.459164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ef222bda-6255-4863-9cad-dffb3b96b05b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149297 Aug 03 10:01:50.459721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1449/3021] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:51.481588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:51.482205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:51.489432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.489886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.490651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.491092 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.621000 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:51.629822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f24844c1-205f-4d5b-a3da-7bb2ab5271ec tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152175 Aug 03 10:01:51.630404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1573/3022] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:51.676130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:51.676628 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:51.682529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.682980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.683736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.684172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.708773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:01:51.782856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f22a3da-0198-4cc3-994b-1c1184809ef3 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 204 len: 0 microversion: 2.1 time: 0.187533 Aug 03 10:01:51.783942 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1450/3023] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:01:51 2022] DELETE /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:01:51.792521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:51.793173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:51.799811 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.800264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.801053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:51.801493 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:51.938287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:51.945782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6e6dcd0c-1484-452e-8ed7-c90852de2c86 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1671 microversion: 2.1 time: 0.157197 Aug 03 10:01:51.946366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1574/3024] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:51 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:52.651922 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:52.652605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:52.659280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:52.659772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:52.660544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:52.661000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:52.801252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:52.809141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ba2dfed3-87c6-41df-9e21-a55e7f05ceef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.161466 Aug 03 10:01:52.809704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1451/3025] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:52.969941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:52.970531 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:52.977575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:52.978046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:52.978791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:52.979218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:53.112095 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:53.119878 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8aa74b39-5298-47f6-9b4a-811ce617a58b tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1671 microversion: 2.1 time: 0.153829 Aug 03 10:01:53.120445 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1575/3026] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:52 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:53.832635 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:53.833271 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:53.839443 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:53.839888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:53.840642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:53.841092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:54.143222 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:54.144791 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:54.153167 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:54.154029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:54.155245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:54.155927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:54.231438 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29203ff4c61c48fd940e6ac6c51e5fea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e293737b69a41e79fdcdbb99baca498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:54.240040 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-048e92d5-8ac4-43f1-86f2-0c93421ce91d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 200 len: 1604 microversion: 2.1 time: 0.101869 Aug 03 10:01:54.240622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1576/3027] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:54 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 1604 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:01:54.354460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:54.364188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2c9307ff-171f-465a-8917-cba21874825d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.536805 Aug 03 10:01:54.380989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1452/3028] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:54.406809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-8a3be7ea-fda5-4c69-847e-27038b9dc0b3 req-db38a0f9-b776-431c-b309-9d668bf10fbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f475884b-478f-4865-ac70-b075342e5bfa", "name": "network-vif-deleted", "tag": "2d3f4432-4c10-438a-be0c-bb140faf08c8"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:01:54.416556 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-8a3be7ea-fda5-4c69-847e-27038b9dc0b3 req-db38a0f9-b776-431c-b309-9d668bf10fbb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:54.417135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-8a3be7ea-fda5-4c69-847e-27038b9dc0b3 req-db38a0f9-b776-431c-b309-9d668bf10fbb service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:54.429671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-8a3be7ea-fda5-4c69-847e-27038b9dc0b3 req-db38a0f9-b776-431c-b309-9d668bf10fbb service nova] Creating event network-vif-deleted:2d3f4432-4c10-438a-be0c-bb140faf08c8 for instance f475884b-478f-4865-ac70-b075342e5bfa on hv-cinder-84456 Aug 03 10:01:54.434547 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-8a3be7ea-fda5-4c69-847e-27038b9dc0b3 req-db38a0f9-b776-431c-b309-9d668bf10fbb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087126 Aug 03 10:01:54.435151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1577/3029] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:01:55.261773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:55.262303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:55.269439 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:55.269885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:55.270645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:55.271109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:55.285387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] HTTP exception thrown: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Request method failure captured: Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa HTTP/1.1 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kAyv3UJAhjtR_JB7yJPFF_C0h8VpqU-6vU11-rRm_vk5VYxjNQWlb6u5hIMd-tJwUs8kJPaG9keJ9C-ir5oLMuoZO-7T2n34Grf_I3oaslD9yg1n_uXixlEVGysAvCbbS8Pxp6rootgxxz6V4_Yf31rWcVpTZKRMBeNwhwB1nQS_4o Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:01:55.287033 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}] Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 29203ff4c61c48fd940e6ac6c51e5fea Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:55.288966 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'f475884b-478f-4865-ac70-b075342e5bfa'} Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:01:55.289916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:55.291644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:55.293302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Returning 404 to user: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:01:55.293302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-37770b1c-c454-4502-b8db-24eb960bf8f1 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 03 10:01:55.293302 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1453/3030] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:55 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:01:55.298478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0e0a66d1-9aa8-437f-9d2f-cc2f6d8a8b1f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '.version_select at 0x7fb9998340d0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:55.322639 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0e0a66d1-9aa8-437f-9d2f-cc2f6d8a8b1f tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-604405953" status: 202 len: 0 microversion: 2.1 time: 0.028740 Aug 03 10:01:55.323205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1578/3031] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 3 10:01:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-604405953 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:01:55.386326 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:55.386926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:55.393644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:55.394089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:55.394846 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:55.395273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:55.559912 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:55.568728 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3c678049-9684-4274-8412-be2985b5daef tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.186344 Aug 03 10:01:55.569410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1454/3032] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:55.993401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:55.994022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:56.000753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.001238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.002578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.003019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.005725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=92 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:01:56.017075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] HTTP exception thrown: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Request method failure captured: Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa HTTP/1.1 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kAyv3UJAhjtR_JB7yJPFF_C0h8VpqU-6vU11-rRm_vk5VYxjNQWlb6u5hIMd-tJwUs8kJPaG9keJ9C-ir5oLMuoZO-7T2n34Grf_I3oaslD9yg1n_uXixlEVGysAvCbbS8Pxp6rootgxxz6V4_Yf31rWcVpTZKRMBeNwhwB1nQS_4o Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:01:56.018795 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}] Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 29203ff4c61c48fd940e6ac6c51e5fea Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.020545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'f475884b-478f-4865-ac70-b075342e5bfa'} Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:01:56.021690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.023360 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.025043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Returning 404 to user: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:01:56.025043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d533cec3-6a1e-48f7-ac49-c924928fdf6d tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 404 len: 111 microversion: 2.1 time: 0.030807 Aug 03 10:01:56.025043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1579/3033] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:01:55 2022] DELETE /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:01:56.028636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:56.029284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: f475884b-478f-4865-ac70-b075342e5bfa] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:56.035385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.035834 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.036594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.037068 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.050767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] HTTP exception thrown: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Request method failure captured: Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa HTTP/1.1 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kAyv3UJAhjtR_JB7yJPFF_C0h8VpqU-6vU11-rRm_vk5VYxjNQWlb6u5hIMd-tJwUs8kJPaG9keJ9C-ir5oLMuoZO-7T2n34Grf_I3oaslD9yg1n_uXixlEVGysAvCbbS8Pxp6rootgxxz6V4_Yf31rWcVpTZKRMBeNwhwB1nQS_4o Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:01:56.052328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}] Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 29203ff4c61c48fd940e6ac6c51e5fea Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.054234 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'f475884b-478f-4865-ac70-b075342e5bfa'} Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:01:56.055238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. Aug 03 10:01:56.056992 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:01:56.058465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Returning 404 to user: Instance f475884b-478f-4865-ac70-b075342e5bfa could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:01:56.058465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a36d0a0b-4ec2-473d-9f74-ac9e1821fb13 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa" status: 404 len: 111 microversion: 2.1 time: 0.028914 Aug 03 10:01:56.058465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1455/3034] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:56 2022] GET /compute/v2.1/servers/f475884b-478f-4865-ac70-b075342e5bfa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 03 10:01:56.590980 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:56.591580 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:56.599091 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.599534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.600293 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:56.600723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:56.733294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:56.741596 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e363499e-0ee5-4101-b4a8-fe59fa81721e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154981 Aug 03 10:01:56.752875 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1580/3035] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:57.763145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:57.763682 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:57.770760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:57.771206 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:57.771983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:57.772415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:57.900219 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:57.908783 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5f4c47da-db70-4cf7-b5c2-ceaf4ffdc133 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148941 Aug 03 10:01:57.909584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1456/3036] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:01:58.930742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:01:58.931343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:01:58.937982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:58.938423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:58.939884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:01:58.940478 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:01:59.066968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:01:59.075279 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3240af87-5d92-4799-bd3f-9721a95cdfb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148384 Aug 03 10:01:59.075904 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1581/3037] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:01:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:00.096127 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:00.096734 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:00.103445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:00.103890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:00.104646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:00.105115 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:00.235412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:00.243398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-cba30f10-c7ed-4088-b33a-df350826e0b4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151313 Aug 03 10:02:00.243975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1457/3038] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:00 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:01.265428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:01.266037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:01.273368 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:01.273818 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:01.274577 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:01.275034 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:01.408340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:01.416305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-51daf7cf-4bc6-4a05-86b9-7a1c9c1fd458 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154729 Aug 03 10:02:01.416893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1582/3039] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:02.437250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:02.437869 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:02.445061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:02.445504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:02.446254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:02.446686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:02.574739 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:02.583093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc89dc92-18cd-4b1b-b9f6-c6fffd0009dc tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149685 Aug 03 10:02:02.583683 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1458/3040] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:03.603987 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:03.604597 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:03.611679 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:03.612130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:03.612901 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:03.613333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:03.741200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:03.749022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96c6a868-46df-49cb-9962-75cccd58ba20 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148936 Aug 03 10:02:03.749584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1583/3041] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:04.770672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:04.771285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:04.778141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:04.778613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:04.779371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:04.779803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:04.911104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:04.917505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7178b2d2-f168-40d6-9d83-9dfde4849cca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151522 Aug 03 10:02:04.918082 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1459/3042] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:05.939552 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:05.940301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:05.946746 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:05.947187 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:05.947937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:05.948365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:06.093136 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:06.101659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b1100b13-74af-4d94-8e68-5217e8df2906 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.166848 Aug 03 10:02:06.102234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1584/3043] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:05 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:07.123154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:07.123811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:07.130438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:07.130881 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:07.131631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:07.132230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:07.150945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:07.270774 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:07.278812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12090b0f-3410-47b4-b4ca-c1a527fe44d2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.159492 Aug 03 10:02:07.279372 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1460/3044] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:08.301705 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:08.302343 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:08.308877 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:08.309276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:08.310025 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:08.310455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:08.445265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:08.453928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-70c0fe22-3548-44c2-9f0e-7aec3dbcaaf5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156984 Aug 03 10:02:08.454525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1585/3045] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:09.475010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:09.475601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:09.482034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:09.482473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:09.483215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:09.483641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:09.616681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:09.624586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d28761b8-def1-46c0-89d4-38dcfd2aee97 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153487 Aug 03 10:02:09.625174 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1461/3046] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:10.647251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:10.647846 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:10.654326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:10.654774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:10.655517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:10.655947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:10.788103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:10.796014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dc0f9fc3-2fea-42dc-a880-ad0c6e24547d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152594 Aug 03 10:02:10.796579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1586/3047] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:11.817844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:11.818373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:11.820790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:11.826936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:11.827398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:11.828153 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:11.828582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:11.955367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:11.963247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ad2aee95-1aa4-4dc1-9419-4f94135c0d22 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150003 Aug 03 10:02:11.963803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1462/3048] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:12.985119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:12.985732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:12.988048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:12.993398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:12.993849 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:12.994602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:12.995039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:13.124272 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:13.133087 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f934e1c6-4920-4a58-b349-f5c4df3d96bf tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151803 Aug 03 10:02:13.133661 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1587/3049] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:12 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:14.154245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:14.154898 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:14.162220 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:14.162669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:14.163428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:14.163864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:14.295976 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:14.304137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9d3d34ba-8a08-4150-9279-198117d07069 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153774 Aug 03 10:02:14.304767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1463/3050] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:15.325985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:15.326516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:15.333551 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:15.334003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:15.334772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:15.335217 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:15.464928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:15.473656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96d857f5-dbaa-4e79-ad5d-93e16a3a892f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151841 Aug 03 10:02:15.474219 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1588/3051] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:16.495008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:16.495617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:16.502436 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:16.502882 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:16.503643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:16.504078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:16.630139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:16.638837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6f21766f-ec54-4af4-857d-05c4937bc128 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147732 Aug 03 10:02:16.639413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1464/3052] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:17.661324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:17.661927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:17.668348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:17.668788 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:17.669571 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:17.669998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:17.798299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:17.806348 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e42c2efd-7218-410d-95d4-e24cda5b8294 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149140 Aug 03 10:02:17.806917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1589/3053] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:18.827717 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:18.828321 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:18.835444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:18.835888 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:18.836636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:18.837094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:18.965844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:18.973872 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ce68d726-bec5-48bd-8a0b-52fb24e321ad tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150269 Aug 03 10:02:18.974428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1465/3054] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:18 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:19.994891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:19.995503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:20.002283 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:20.002725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:20.003473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:20.003899 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:20.136991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:20.145688 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c394ee3c-cd92-4009-a314-8d39f5d692f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154656 Aug 03 10:02:20.146249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1590/3055] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:21.166564 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:21.167167 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:21.173854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:21.174296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:21.175073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:21.175523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:21.307771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:21.316330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-89ac2817-04be-4133-81fe-06cd2ea4bdea tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153576 Aug 03 10:02:21.316935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1466/3056] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:22.338165 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:22.338737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:22.345959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:22.346414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:22.347172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:22.347604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:22.475519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:22.483328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0dd9e60c-0c43-4400-91a8-16388a5b16f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149099 Aug 03 10:02:22.483884 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1591/3057] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:23.503556 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:23.504164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:23.510381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:23.510827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:23.511579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:23.512008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:23.534177 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:02:23.534369 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:02:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c (ip 10.222.0.20) !!! Aug 03 10:02:23.642584 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:23.650415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-56e0ae18-d132-4f4a-b764-fbbdb031b51b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150867 Aug 03 10:02:23.650978 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1467/3058] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:24.671519 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:24.672110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:24.678604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:24.679053 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:24.679855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:24.680292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:24.809447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:24.817906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e74940ee-6481-46ae-a2b8-1de5452a06a7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150300 Aug 03 10:02:24.818470 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1592/3059] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:25.839676 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:25.840287 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:25.847507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:25.847945 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:25.848697 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:25.849161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:25.980649 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:25.988768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25c8837c-36c7-4e14-8ba4-57c1d8b0ea37 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153106 Aug 03 10:02:25.989425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1468/3060] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:25 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:27.010657 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:27.011252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:27.018703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:27.019244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:27.020065 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:27.020527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:27.023298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=80 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:27.152828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:27.160927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-22c82f1b-de8e-4c6d-a4b1-7405950feb46 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154084 Aug 03 10:02:27.161490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1593/3061] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:28.182032 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:28.182651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:28.189193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:28.189643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:28.190408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:28.190856 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:28.318052 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:28.326238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2047204a-0137-404c-afb6-22abe3fae42e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148181 Aug 03 10:02:28.326835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1469/3062] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:29.348020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:29.348585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:29.355069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:29.355546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:29.356297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:29.356729 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:29.483276 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:29.491914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45ac667f-5519-4233-b7cd-f190b10eea76 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148323 Aug 03 10:02:29.492476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1594/3063] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:30.512985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:30.513603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:30.520592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:30.521080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:30.521838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:30.522273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:30.653023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:30.661896 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0f4c6149-2e6e-45db-9e39-3d682843efd3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152992 Aug 03 10:02:30.662463 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1470/3064] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:31.683572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:31.684153 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:31.691300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:31.691753 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:31.692513 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:31.692985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:31.822407 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:31.831210 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcc26358-5651-4d3c-b156-d99cb6ee1274 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151659 Aug 03 10:02:31.831774 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1595/3065] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:32.852159 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:32.852767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:32.859210 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:32.859653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:32.860929 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:32.861401 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:32.993021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:33.000926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-28dc3a8b-cac6-4698-ab98-e143f6485f98 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152630 Aug 03 10:02:33.001528 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1471/3066] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:32 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:34.022654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:34.023302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:34.029858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:34.030309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:34.031064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:34.031501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:34.163039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:34.170972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-87e59928-648e-45a6-a91c-900062978a25 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152246 Aug 03 10:02:34.171535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1596/3067] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:35.192647 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:35.193277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:35.200300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:35.200794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:35.201637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:35.202066 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:35.332789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:35.340711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e4716313-fd17-447f-8919-44031e882aed tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152103 Aug 03 10:02:35.341306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1472/3068] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:36.363717 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:36.364326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:36.370759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:36.371205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:36.371954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:36.372379 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:36.497893 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:36.506743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e847842b-def4-49f4-9a39-0b2180b90908 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147550 Aug 03 10:02:36.507311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1597/3069] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:37.528394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:37.529018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:37.536046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:37.536484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:37.537257 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:37.537681 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:37.541532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=76 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:37.674548 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:37.682382 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4cb6aa07-e280-4f9b-bcaa-8592653158b8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.157862 Aug 03 10:02:37.682943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1473/3070] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:38.704437 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:38.705618 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:38.712203 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:38.712652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:38.713443 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:38.713879 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:38.845214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:38.853941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7ae9f947-19f9-4874-a913-693d2ea41a58 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153327 Aug 03 10:02:38.854512 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1598/3071] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:39.874633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:39.875243 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:39.881787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:39.882224 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:39.882973 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:39.883403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:40.013598 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:40.022260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bab5278f-3a7b-4867-bead-d46e0203f8d3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151532 Aug 03 10:02:40.022835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1474/3072] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:39 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:41.044356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:41.045015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:41.052581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:41.053057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:41.053822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:41.054263 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:41.182832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:41.191060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d5d080d-d870-46c8-b6e2-b81ca1ecd76e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150970 Aug 03 10:02:41.191637 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1599/3073] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:42.212535 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:42.213157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:42.215446 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:42.220993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:42.221444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:42.222362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:42.222798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:42.356228 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:42.364101 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1d199f9a-3dab-4544-b176-f74c66209a49 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.155462 Aug 03 10:02:42.364656 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1475/3074] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:43.385322 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:43.385927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:43.388192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=26 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:43.393396 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:43.393836 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:43.394710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:43.395141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:43.526132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:43.534460 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5f005182-c3b7-4ead-8afe-93c49ff56266 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152752 Aug 03 10:02:43.534738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1600/3075] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:44.556091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:44.556704 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:44.563339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:44.563787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:44.564542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:44.565027 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:44.705838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:44.713818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-97f1b0d6-b9cc-4790-a42b-d62b2c157225 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.161680 Aug 03 10:02:44.714373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1476/3076] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:45.735216 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:45.735821 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:45.742292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:45.742730 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:45.743471 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:45.743896 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:45.870826 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:45.879289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-60a3d31b-3b4e-43f8-8235-cf4a9c0e9955 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147429 Aug 03 10:02:45.879862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1601/3077] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:46.899604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:46.900205 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:46.906827 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:46.907269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:46.908024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:46.908457 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:47.037673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:47.045464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-02d94b48-1cba-4821-a8b7-eb6822cb8c9b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149778 Aug 03 10:02:47.046023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1477/3078] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:46 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:48.068152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:48.068793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:48.075570 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:48.076016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:48.076773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:48.077237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:48.208243 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:48.216186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7efea46-15ad-454f-9a16-b78baf659959 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152927 Aug 03 10:02:48.216744 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1602/3079] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:49.237311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:49.238293 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:49.244542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:49.245036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:49.245792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:49.246225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:49.377196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:49.385608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1c365bf1-ee7f-45df-b9c6-ca59ce240f08 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152169 Aug 03 10:02:49.386178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1478/3080] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:50.407550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:50.408152 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:50.415567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:50.416011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:50.416756 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:50.417211 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:50.547286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:50.555384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-576cf660-b3e8-4238-9fd4-8a1e1811ca90 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151668 Aug 03 10:02:50.555947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1603/3081] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:51.576801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:51.577432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:51.584370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:51.584830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:51.585618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:51.586048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:51.714530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:51.723090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-02c7eb62-5279-4828-8317-a8d312b20daa tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150301 Aug 03 10:02:51.723650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1479/3082] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:52.743650 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:52.744260 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:52.750770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:52.751215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:52.751968 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:52.752409 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:52.883148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:52.891052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62c267e7-5fe4-4e08-990d-30d31cf2655d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151470 Aug 03 10:02:52.891606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1604/3083] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:53.913592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:53.914226 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:53.920494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:53.920972 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:53.921724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:53.922152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:54.054245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:54.062639 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a5865d09-ef7f-4936-96e8-20c5bfce64c0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153627 Aug 03 10:02:54.063207 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1480/3084] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:53 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:55.085209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:55.085755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:55.092292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:55.092741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:55.093528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:55.093961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:55.225307 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:55.233393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62f0e819-a989-4e00-badd-36f742e7eeb3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152275 Aug 03 10:02:55.233956 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1605/3085] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:56.255643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:56.256425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:56.263078 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:56.263523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:56.264289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:56.264722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:56.467391 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:56.475425 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3eff6710-b56b-49c9-aa69-a94aae420065 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.223722 Aug 03 10:02:56.476000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1481/3086] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:57.497009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:57.497622 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:57.504083 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:57.504524 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:57.505292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:57.505720 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:57.508399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:02:57.632294 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:57.640172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-405b7261-d39d-4478-b3ff-56c491605c8e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147089 Aug 03 10:02:57.640726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1606/3087] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:58.661790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:58.663107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:58.669735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:58.670179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:58.670930 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:58.671362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:58.801505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:02:58.810022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae8a1d35-6af7-49b9-86c0-a600c571d46b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152129 Aug 03 10:02:58.810601 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1482/3088] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:02:59.831732 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:02:59.832320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:02:59.838905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:59.839355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:02:59.840132 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:02:59.840563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:00.198742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:00.206652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-332b158c-57d2-4caf-8147-785ebdf17e04 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.378887 Aug 03 10:03:00.207214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1607/3089] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:02:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:01.228022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:01.228619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:01.235264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:01.235708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:01.236454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:01.236907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:01.363840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:01.372919 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-92ee5af5-e7b5-4422-8f00-af6a6442e4cb tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148886 Aug 03 10:03:01.373512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1483/3090] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:02.396127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:02.396745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:02.404194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:02.404642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:02.405430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:02.405867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:02.533214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:02.541435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e91bf037-c9ce-415d-bc4c-a20375857de9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149254 Aug 03 10:03:02.542320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1608/3091] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:03.743410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:03.744018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:03.749938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:03.750381 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:03.751133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:03.751592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:03.875809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:03.884195 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-12af700b-cff7-4109-87dc-e3618795d7a0 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.325033 Aug 03 10:03:03.884760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1484/3092] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:04.960420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:04.961940 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:04.968457 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:04.968934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:04.969689 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:04.970121 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:05.106159 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:05.114062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5bb8607a-70ea-4091-94a7-75019a30c53a tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.157534 Aug 03 10:03:05.114658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1609/3093] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:06.136193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:06.136799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:06.143285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:06.143729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:06.144494 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:06.144958 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:06.273016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:06.281844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e8dac714-4167-4b67-8e9d-83fa435e7c8d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150058 Aug 03 10:03:06.282416 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1485/3094] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:06 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:07.303391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:07.304016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:07.310558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:07.310943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:07.311684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:07.312109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:07.444486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:07.452832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-269c25bf-07ac-4c3f-a927-bf8330061fe8 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153352 Aug 03 10:03:07.453398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1610/3095] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:07 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:08.475809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:08.479202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:08.486455 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:08.486907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:08.487699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:08.488136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:08.498679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=78 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:08.629796 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:08.638267 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c67ae6ed-47c8-484c-bc0f-6ef26b6db61c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.166226 Aug 03 10:03:08.638759 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1486/3096] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:08 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:09.659516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:09.660160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:09.667384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:09.667832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:09.668588 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:09.669046 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:09.798722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:09.806675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d2ea49e-1372-401d-ab9b-22cab1be4a42 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151100 Aug 03 10:03:09.807238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1611/3097] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:09 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:10.827586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:10.828182 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:10.834690 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:10.835128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:10.835891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:10.836313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:10.965356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:10.973145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-49a05531-7997-4395-8bd1-0d2676c8ea6e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149657 Aug 03 10:03:10.973706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1487/3098] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:10 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:11.994930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:11.995534 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:12.001957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:12.002402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:12.003148 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:12.003579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:12.134063 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:12.142111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5ad7e61c-eea6-492d-93c9-67516ccb5a05 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151506 Aug 03 10:03:12.142833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1612/3099] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:11 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:13.163594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:13.164198 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:13.166648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:13.171902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:13.172338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:13.173119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:13.173547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:13.299812 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:13.308045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bd54d260-29d1-4110-8e43-a797e000e444 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148212 Aug 03 10:03:13.308542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1488/3100] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:13 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:14.330072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:14.330645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:14.332658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=26 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:14.338841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:14.339299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:14.340060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:14.340496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:14.467289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:14.475088 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04290862-ff12-4346-beb2-b282b0cc5632 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149034 Aug 03 10:03:14.475649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1613/3101] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:14 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:15.496928 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:15.497526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:15.503999 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:15.504434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:15.505212 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:15.505638 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:15.638268 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:15.646137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f5ebeb6d-f845-4144-8ab5-512ad857f0f4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153255 Aug 03 10:03:15.646708 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1489/3102] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:15 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:16.668296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:16.668925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:16.675511 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:16.675962 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:16.676715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:16.677246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:16.813104 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:16.821086 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f1d77a83-5de0-49d4-8a77-5997f8b0c19e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.157347 Aug 03 10:03:16.821654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1614/3103] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:16 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:17.842811 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:17.843358 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:17.849927 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:17.850402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:17.851165 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:17.851600 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:17.979402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:17.987196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1e03c950-5f0d-4e76-80a6-ec0dd2428334 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148347 Aug 03 10:03:17.987771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1490/3104] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:17 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:19.009374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:19.009974 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:19.016528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:19.017005 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:19.017749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:19.018178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:19.151019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:19.158892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-097263cd-fdbd-4e77-ae27-ce9f8eb643ca tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153507 Aug 03 10:03:19.159454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1615/3105] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:19 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:20.181238 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:20.181891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:20.188375 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:20.188854 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:20.189619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:20.190062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:20.320659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:20.326048 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ef9cea3-7651-4bb2-988b-56e9c2b42fb7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149435 Aug 03 10:03:20.326614 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1491/3106] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:20 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:21.347853 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:21.348436 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:21.355171 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:21.355624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:21.356381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:21.356838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:21.488743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:21.497350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f3f03b07-cb88-4f46-9ace-d696a346d9c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153499 Aug 03 10:03:21.497918 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1616/3107] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:21 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:22.518733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:22.519342 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:22.527041 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:22.527487 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:22.528240 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:22.528670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:22.663308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:22.671275 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-01c05a46-a0ab-42cc-88ff-2eba86544306 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156424 Aug 03 10:03:22.671848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1492/3108] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:22 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:23.692462 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:23.693093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:23.700384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:23.700847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:23.701607 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:23.702038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:23.834604 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:23.843365 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d2506f07-cf7c-4fa6-b779-5aba91cc4aa3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154751 Aug 03 10:03:23.843933 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1617/3109] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:23 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:24.864158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:24.864762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:24.871627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:24.872070 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:24.872850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:24.873290 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:25.002507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:25.011606 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-25d8e516-b5a2-4cb8-86b0-4e3af210907d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151495 Aug 03 10:03:25.012170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1493/3110] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:24 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:26.032663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:26.033298 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:26.040640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:26.041109 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:26.041867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:26.042302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:26.173197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:26.182353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eb7dabaa-7f38-4eef-a06c-d7252d9594a4 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153544 Aug 03 10:03:26.182921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1618/3111] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:26 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:27.203394 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:27.204021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:27.210596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:27.211050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:27.212003 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:27.212434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:27.343472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:27.351284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dae49fd4-233d-47ff-9dce-5c9e0a370b81 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151825 Aug 03 10:03:27.351884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1494/3112] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:27 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:28.372786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:28.373415 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:28.379828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:28.380265 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:28.381052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:28.381480 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:28.384485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:28.512084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:28.519960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1bd43ddd-71f1-4789-9584-234122012f66 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151240 Aug 03 10:03:28.520527 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1619/3113] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:28 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:29.542848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:29.543476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:29.549926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:29.550373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:29.551151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:29.551586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:29.679413 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:29.687797 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-42923cbe-4fb0-482c-81fd-a569488b76c2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149893 Aug 03 10:03:29.688367 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1495/3114] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:29 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:30.710309 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:30.710910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:30.717721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:30.718161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:30.718905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:30.719333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:30.847690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:30.856093 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-683399c6-4074-49c0-a268-baa63c142940 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149686 Aug 03 10:03:30.856654 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1620/3115] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:30 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:31.877192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:31.877857 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:31.884853 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:31.885299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:31.886044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:31.886489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:32.015672 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:32.023504 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a291d140-8259-4d30-9840-a3474d8cbf3d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150198 Aug 03 10:03:32.024061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1496/3116] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:31 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:33.044696 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:33.045301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:33.051999 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:33.052449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:33.053237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:33.053673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:33.190606 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:33.199725 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ef7da4d-a35c-4c33-85ff-0a925ac8a7c3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.158953 Aug 03 10:03:33.200286 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1621/3117] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:33 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:34.220951 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:34.221557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:34.228937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:34.229379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:34.230130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:34.230559 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:34.360604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:34.369237 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2e066add-d307-4276-9c4b-fbbe36d9f1e9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152145 Aug 03 10:03:34.369798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1497/3118] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:34 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:35.389855 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:35.390465 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:35.397151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:35.397603 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:35.398354 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:35.398792 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:35.525236 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:35.533830 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1754393f-7a53-4744-acd3-ed090f453e74 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147913 Aug 03 10:03:35.534398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1622/3119] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:35 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:36.555530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:36.556139 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:36.563603 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:36.564044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:36.564795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:36.565249 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:36.697344 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:36.706459 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-be92e5e7-0c55-4b2e-be39-9e028e8b18b1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.154786 Aug 03 10:03:36.707022 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1498/3120] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:36 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:37.728370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:37.729020 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:37.736114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:37.736564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:37.737346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:37.737782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:37.867397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:37.876021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8bf9fe77-339e-4037-9f50-63b60e25a636 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151519 Aug 03 10:03:37.876587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1623/3121] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:37 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:38.896889 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:38.897480 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:38.904587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:38.905061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:38.905822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:38.906260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:38.910164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=78 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:39.037990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:39.046594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9fe5490-fea0-49ae-ad60-4e090544e355 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153613 Aug 03 10:03:39.047152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1499/3122] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:38 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:40.067475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:40.068084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:40.075715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:40.076162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:40.076955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:40.077392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:40.208789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:40.217392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-6dae4f43-41d1-40e6-98d2-9d6a25e8f12f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.153810 Aug 03 10:03:40.217950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1624/3123] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:40 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:41.239128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:41.239736 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:41.246905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:41.247345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:41.248091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:41.248520 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:41.377825 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:41.385707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-06888518-ab69-4d60-86bd-d968fe58af51 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150543 Aug 03 10:03:41.387227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1500/3124] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:41 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:42.408424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:42.409062 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:42.415475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:42.415916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:42.416659 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:42.417745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:42.545945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:42.553819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd6e003c-df44-4b8c-a45a-9f41e38a8ca7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149267 Aug 03 10:03:42.554374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1625/3125] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:42 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:43.576400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:43.577025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:43.579317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=26 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:43.584502 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:43.584970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:43.585720 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:43.586143 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:43.715279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:43.723092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-14e61c83-c51d-4474-af00-2069483311d1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151439 Aug 03 10:03:43.723650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1501/3126] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:43 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:44.744796 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:44.746029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:44.747906 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=26 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:44.753183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:44.753625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:44.754369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:44.754822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:44.885656 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:44.893663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c35407b3-6e1d-4b2c-8bce-d7c6db75914d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152874 Aug 03 10:03:44.894233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1626/3127] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:44 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:45.914285 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:45.914916 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:45.921749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:45.922192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:45.922938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:45.923365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:46.050730 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:46.059146 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ccd26bf8-add4-47bb-9b8b-6b74be48b4a5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148683 Aug 03 10:03:46.059706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1502/3128] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:45 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:47.080710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:47.081490 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:47.088015 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:47.088464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:47.090033 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:47.090473 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:47.220485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:47.228446 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5d97bd9b-3b99-449f-b6d9-36a2332fd939 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.151664 Aug 03 10:03:47.229050 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1627/3129] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:47 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:48.250130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:48.250745 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:48.257272 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:48.257719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:48.258479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:48.258914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:48.386043 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:48.394289 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-034fa7a7-8ee5-4353-a263-bf37976ef96c tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147994 Aug 03 10:03:48.394861 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1503/3130] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:48 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:49.415456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:49.416081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:49.423227 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:49.423674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:49.424424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:49.424886 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:49.551625 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:49.559528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d82b011e-36f8-4031-a377-6cad66c6f6b2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147947 Aug 03 10:03:49.560101 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1628/3131] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:49 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:50.580245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:50.580895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:50.587282 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:50.587722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:50.588513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:50.588983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:50.720617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:50.728580 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a78924e-1ccc-4d07-b47a-1ba2f180d3a3 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152196 Aug 03 10:03:50.729512 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1504/3132] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:50 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:51.751777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:51.752388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:51.758991 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:51.759440 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:51.760189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:51.761476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:51.890842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:51.898653 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e36cbd9e-04c4-4bbc-9f37-026c975c606b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150722 Aug 03 10:03:51.899204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1629/3133] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:51 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:52.920726 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:52.921362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:52.927799 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:52.928242 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:52.929035 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:52.929471 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:53.059259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:53.067279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c1c1596f-ebff-4b50-b887-1ac4f3cf9e09 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150803 Aug 03 10:03:53.067838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1505/3134] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:52 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:54.090230 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:54.091246 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:54.099881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:54.100327 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:54.101116 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:54.101550 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:54.245910 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:54.255476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cd628387-840b-4411-99b1-9c7c28e3d7b9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.170304 Aug 03 10:03:54.256084 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1630/3135] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:54 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:55.279818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:55.280414 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:55.286644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:55.287083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:55.287829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:55.288255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:55.416747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:55.424699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d9dd9f9f-6204-4497-9127-df081034fb75 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149627 Aug 03 10:03:55.425294 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1506/3136] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:55 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:56.446316 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:56.446927 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:56.454011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:56.454455 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:56.455209 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:56.455641 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:56.590988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:56.598789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-22ca33e8-14ed-4f74-8cbe-ce35324b4da9 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.156324 Aug 03 10:03:56.599353 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1631/3137] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:56 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:57.621129 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:57.621731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:57.628232 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:57.628670 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:57.629451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:57.629875 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:57.755926 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:57.764530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d25700d0-5650-4ad3-a563-46444d07d7f7 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.148060 Aug 03 10:03:57.765125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1507/3138] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:57 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:03:58.785739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:58.786342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:58.793793 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:58.794241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:58.795001 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:58.795433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:58.798003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=78 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:03:58.924763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:03:58.932882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-cc4bd138-d77a-4aac-9dce-95ef28bb0a63 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.150956 Aug 03 10:03:58.933448 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1632/3139] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:58 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:03:59.954482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:03:59.955094 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:03:59.961568 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:59.962008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:03:59.962761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:03:59.963767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:00.095244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:04:00.103073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0ecedacd-2099-4ea8-9de3-3a8778def46e tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.152490 Aug 03 10:04:00.103634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1508/3140] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:03:59 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:04:00.608075 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:04:00.608681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:04:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:04:01.125325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:04:01.125947 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:04:01.132479 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:01.132959 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:01.133727 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:01.134161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:01.272395 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:04:01.280418 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcc4bf99-5d20-4dcd-a746-4ccd02cb71be tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.158979 Aug 03 10:04:01.281004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1633/3141] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:04:01 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:04:02.301983 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:04:02.302604 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:04:02.309356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:02.309738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:02.310484 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:02.310910 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:02.438119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:04:02.446077 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5bc19a8b-a7db-4b61-b2c4-8688e26f628d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.147951 Aug 03 10:04:02.446643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1509/3142] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:04:02 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:04:03.467485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:04:03.468071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:04:03.474574 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:03.475018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:03.475761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:03.476193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:03.604786 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:04:03.612605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f0f6aedd-dd46-43ec-bbd9-8e669884643d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.149085 Aug 03 10:04:03.613186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1634/3143] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:04:03 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:04:04.634021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:04:04.634644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 3d91625e-8ed4-43db-8a95-714abb859a9c] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:04:04.641685 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:04.642109 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:04.642852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:04.643279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:04.768790 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:04:04.777016 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ae259280-c25c-42a2-98e3-1d635334cdb1 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c" status: 200 len: 1734 microversion: 2.1 time: 0.146788 Aug 03 10:04:04.777578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1510/3144] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:04:04 2022] GET /compute/v2.1/servers/3d91625e-8ed4-43db-8a95-714abb859a9c => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:04:04.797166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e0797aa2-49e4-4c7f-9d3d-339df6301564 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '.version_select at 0x7fb999640670>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:04:04.815486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e0797aa2-49e4-4c7f-9d3d-339df6301564 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-513999002" status: 202 len: 0 microversion: 2.1 time: 0.022047 Aug 03 10:04:04.816038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1635/3145] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 3 10:04:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-513999002 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:04:05.820137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:04:05.830330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:04:05.830765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:04:05.842230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] Creating event network-changed:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 10:04:05.845688 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR oslo.messaging._drivers.impl_rabbit [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] [fa5ab23d-89fb-4a1c-baac-3d6295d8feb6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 10:04:06.853509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] [fa5ab23d-89fb-4a1c-baac-3d6295d8feb6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43854. Aug 03 10:04:06.856751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-57663b2c-86a9-4e75-99ae-23b069b1ad8f req-5fb9d66b-db8f-4348-bc52-cc73ec918af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.163323 Aug 03 10:04:06.857379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1511/3146] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:04:23.917722 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:04:23.918278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:04:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:05:27.332475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:05:27.333065 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:05:30.684555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=17 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:30.685784 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:30.690820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:30.691523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:30.701805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:30.702358 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:30.703303 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:30.703892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:30.731237 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:05:30.834873 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.compute.api [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Instance is already in deleting state, ignoring this request Aug 03 10:05:30.836060 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-85c6da75-919b-425c-a7d1-a212e3e560c5 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 204 len: 0 microversion: 2.20 time: 0.153419 Aug 03 10:05:30.837144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1636/3147] 10.222.0.20 () {60 vars in 1280 bytes} [Wed Aug 3 10:05:30 2022] DELETE /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 03 10:05:30.843269 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR oslo.messaging._drivers.impl_rabbit [-] [30078e12-bde3-4175-a237-1377ff4cb23a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 03 10:05:30.843847 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=21 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:30.844505 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=73 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:30.849803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:30.850553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:30.858335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:30.858784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:30.859549 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:30.859988 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:30.898695 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:30.899619 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:30.900602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lazy-loading 'fault' on Instance uuid c30c986d-ad83-45a8-b4e6-96d056aaa6d5 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:05:30.958260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:30.968340 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:30.970253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:30.972333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-0d3a6a60-5ee5-4730-b33d-b9ae4ab0daf8 tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1538 microversion: 2.20 time: 0.130739 Aug 03 10:05:30.983299 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1512/3148] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 10:05:30 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1538 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:05:31.795663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:31.796151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:31.803079 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:31.803530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:31.804292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:31.804740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:31.819421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] HTTP exception thrown: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Request method failure captured: Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd HTTP/1.1 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kAyv3UJAhjtR_JB7yJPFF_C0h8VpqU-6vU11-rRm_vk5VYxjNQWlb6u5hIMd-tJwUs8kJPaG9keJ9C-ir5oLMuoZO-7T2n34Grf_I3oaslD9yg1n_uXixlEVGysAvCbbS8Pxp6rootgxxz6V4_Yf31rWcVpTZKRMBeNwhwB1nQS_4o Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:31.821579 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}] Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 29203ff4c61c48fd940e6ac6c51e5fea Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.823518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '92a1a022-8f7e-4e28-9a07-49184dfcfcfd'} Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:31.824423 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.826252 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.831280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Returning 404 to user: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:31.832131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d9ff7129-953a-4440-b202-e68de6e4d0f6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 404 len: 111 microversion: 2.1 time: 0.040589 Aug 03 10:05:31.832681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1637/3149] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:05:31 2022] DELETE /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:31.840530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:31.841155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] [instance: 92a1a022-8f7e-4e28-9a07-49184dfcfcfd] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:31.849010 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:31.849629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:31.850254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:31.850876 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:31.869337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] [30078e12-bde3-4175-a237-1377ff4cb23a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43940. Aug 03 10:05:31.870821 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] HTTP exception thrown: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Request method failure captured: Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd HTTP/1.1 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kAyv3UJAhjtR_JB7yJPFF_C0h8VpqU-6vU11-rRm_vk5VYxjNQWlb6u5hIMd-tJwUs8kJPaG9keJ9C-ir5oLMuoZO-7T2n34Grf_I3oaslD9yg1n_uXixlEVGysAvCbbS8Pxp6rootgxxz6V4_Yf31rWcVpTZKRMBeNwhwB1nQS_4o Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:05:31.872509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0e293737b69a41e79fdcdbb99baca498"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0e293737b69a41e79fdcdbb99baca498"}]}] Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 0e293737b69a41e79fdcdbb99baca498 Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-AttachVolumeTestJSON-382633331 Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 29203ff4c61c48fd940e6ac6c51e5fea Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-AttachVolumeTestJSON-382633331-project Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.874545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '92a1a022-8f7e-4e28-9a07-49184dfcfcfd'} Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:31.875417 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. Aug 03 10:05:31.877001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:31.878777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] Returning 404 to user: Instance 92a1a022-8f7e-4e28-9a07-49184dfcfcfd could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:31.878777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-aaffd76e-e27a-4564-8399-1ec5377991d6 tempest-AttachVolumeTestJSON-382633331 tempest-AttachVolumeTestJSON-382633331-project] 10.222.0.20 "GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd" status: 404 len: 111 microversion: 2.1 time: 0.037199 Aug 03 10:05:31.878777 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1513/3150] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:31 2022] GET /compute/v2.1/servers/92a1a022-8f7e-4e28-9a07-49184dfcfcfd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:31.997166 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:31.997763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:32.007979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:32.008464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:32.009332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:32.009900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:32.075391 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:32.075758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:32.076333 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lazy-loading 'fault' on Instance uuid c30c986d-ad83-45a8-b4e6-96d056aaa6d5 {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:05:32.413477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:32.423935 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:32.426257 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '317467d6f856435f8f7eee33eb92c6e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a4f922101d8435d977a4df9843338e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:32.427474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-ba3a092f-f54f-4e47-8a5d-87d0a8471cef tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 200 len: 1460 microversion: 2.20 time: 0.434786 Aug 03 10:05:32.428030 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1638/3151] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 10:05:31 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 1460 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 03 10:05:32.726597 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-674b56fa-3881-4387-ad56-127903a7a48f req-09c97458-98f7-4b80-ad2b-de6544cc8166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d91625e-8ed4-43db-8a95-714abb859a9c", "name": "network-vif-deleted", "tag": "3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:32.738248 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-674b56fa-3881-4387-ad56-127903a7a48f req-09c97458-98f7-4b80-ad2b-de6544cc8166 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:32.738897 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-674b56fa-3881-4387-ad56-127903a7a48f req-09c97458-98f7-4b80-ad2b-de6544cc8166 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:32.752089 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-674b56fa-3881-4387-ad56-127903a7a48f req-09c97458-98f7-4b80-ad2b-de6544cc8166 service nova] Creating event network-vif-deleted:3b6e39b2-6dc5-4a12-92a1-59f8cf3cba1b for instance 3d91625e-8ed4-43db-8a95-714abb859a9c on hv-cinder-84456 Aug 03 10:05:32.759223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-674b56fa-3881-4387-ad56-127903a7a48f req-09c97458-98f7-4b80-ad2b-de6544cc8166 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035941 Aug 03 10:05:32.760119 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1514/3152] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:32.998120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:32.998675 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:33.006414 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.007117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.008056 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.009305 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.040557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:05:33.140615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-eda509ed-0e81-45fc-94f0-2d441a3c025f tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 204 len: 0 microversion: 2.1 time: 0.146106 Aug 03 10:05:33.141311 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1639/3153] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:05:32 2022] DELETE /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:05:33.149798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:33.151145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:33.158250 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.158948 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.159733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.160171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.313909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:33.324448 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-5fad2168-1111-4eb5-8377-ec5cf7e018f2 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1508 microversion: 2.1 time: 0.178323 Aug 03 10:05:33.325259 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1515/3154] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:33 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:33.452586 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:33.453658 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] [instance: c30c986d-ad83-45a8-b4e6-96d056aaa6d5] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:33.460614 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.461345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.462389 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:33.462982 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:33.483134 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] HTTP exception thrown: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Request method failure captured: Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 HTTP/1.1 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA2xIHaKSHD3I5A5Nj7K2Bni6qDT3xpNxynvrpAqw4swoBgJ2IWR6cDtxWcVmZbb21vF0cF9W8eEOO18wzDZUlS_pt8H1lAknJ6UDe7XnutQjLQZZMA_tyxWvl7OTFDQtlEsyw4EPy8EKpHQduSXeqtbtfkMyXnrTymAWZT7lxgG0Y Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Openstack-Nova-Api-Version: 2.20 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:33.485178 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_3a4f922101d8435d977a4df9843338e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/3a4f922101d8435d977a4df9843338e8"}]}] Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 3a4f922101d8435d977a4df9843338e8 Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1147351077 Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 317467d6f856435f8f7eee33eb92c6e3 Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1147351077-project Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. Aug 03 10:05:33.487103 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'c30c986d-ad83-45a8-b4e6-96d056aaa6d5'} Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:33.490955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. Aug 03 10:05:33.493370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:33.498703 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] Returning 404 to user: Instance c30c986d-ad83-45a8-b4e6-96d056aaa6d5 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:33.499649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7846b31c-d895-4ebc-9b7d-c499a003764c tempest-AttachVolumeShelveTestJSON-1147351077 tempest-AttachVolumeShelveTestJSON-1147351077-project] 10.222.0.20 "GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5" status: 404 len: 111 microversion: 2.20 time: 0.051610 Aug 03 10:05:33.505820 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1640/3155] 10.222.0.20 () {60 vars in 1277 bytes} [Wed Aug 3 10:05:33 2022] GET /compute/v2.1/servers/c30c986d-ad83-45a8-b4e6-96d056aaa6d5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:05:34.353357 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:34.355699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:34.382283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:34.383144 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:34.386107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:34.387830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:34.466816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-b78d0766-9b0c-4a30-bdff-77d1ea7bd8f7 req-3d10e4fe-054c-4b73-bf3d-899015accde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b12ac06-e52e-4590-b8ab-1007b884d39a", "name": "network-vif-deleted", "tag": "1113323c-2181-4574-a9f7-316ac94d7b4b"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:34.476642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b78d0766-9b0c-4a30-bdff-77d1ea7bd8f7 req-3d10e4fe-054c-4b73-bf3d-899015accde0 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:34.477475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-b78d0766-9b0c-4a30-bdff-77d1ea7bd8f7 req-3d10e4fe-054c-4b73-bf3d-899015accde0 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:34.491707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-b78d0766-9b0c-4a30-bdff-77d1ea7bd8f7 req-3d10e4fe-054c-4b73-bf3d-899015accde0 service nova] Creating event network-vif-deleted:1113323c-2181-4574-a9f7-316ac94d7b4b for instance 9b12ac06-e52e-4590-b8ab-1007b884d39a on hv-cinder-84456 Aug 03 10:05:34.497528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-b78d0766-9b0c-4a30-bdff-77d1ea7bd8f7 req-3d10e4fe-054c-4b73-bf3d-899015accde0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035087 Aug 03 10:05:34.498627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1641/3156] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:05:34.707189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:34.719313 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-75cb283c-09b4-489b-83a8-4c290eeebad5 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1508 microversion: 2.1 time: 0.376518 Aug 03 10:05:34.720626 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1516/3157] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:34 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:35.733676 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1209586462", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "networks": [{"uuid": "c6a40ddb-746a-4d57-bb3c-c9c8c448d9a2"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:35.742317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:35.744137 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:35.756012 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:35.756706 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:35.757867 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:35.759866 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:35.859668 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] validate_networks() for [('c6a40ddb-746a-4d57-bb3c-c9c8c448d9a2', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:05:36.276117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:36.330188 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1587f389-05c4-4791-a52c-cf0de0884b10 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1508 microversion: 2.1 time: 0.591491 Aug 03 10:05:36.330524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1517/3158] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:35 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1508 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:05:37.357483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:37.359050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:37.366547 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:37.367339 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:37.369214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:37.369914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:37.530145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:05:37.530665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:05:37.531009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:05:37.532251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:05:37.532867 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:05:37.554008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:37.555504 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:37.558213 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:37.559191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:37.560836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:37.613316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2dd71d9f-80f6-4e4c-92e6-25de27a32c0b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 200 len: 1466 microversion: 2.1 time: 0.220214 Aug 03 10:05:37.613909 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Getting quotas for project 7e4ee6e1000f4a87a92c3c34d1432cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:05:37.625233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Getting quotas for user 5bc1f887a65c4473bed69bed5dc8fe9f and project 7e4ee6e1000f4a87a92c3c34d1432cdf. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:05:37.635387 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1518/3159] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:37 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 1466 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:05:37.648093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-d6407f00-fe15-4c29-9d03-ee1b86299d26 req-27446460-3b79-498f-90b3-b4bf218bc24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3166329-2bc2-4aea-983b-a8e05ff43d38", "name": "network-vif-deleted", "tag": "779880c1-0e74-44a1-b797-d284789bbdc6"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:37.650684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:05:37.655546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:05:37.676258 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-d6407f00-fe15-4c29-9d03-ee1b86299d26 req-27446460-3b79-498f-90b3-b4bf218bc24f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:37.679719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-d6407f00-fe15-4c29-9d03-ee1b86299d26 req-27446460-3b79-498f-90b3-b4bf218bc24f service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:37.724349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-d6407f00-fe15-4c29-9d03-ee1b86299d26 req-27446460-3b79-498f-90b3-b4bf218bc24f service nova] Creating event network-vif-deleted:779880c1-0e74-44a1-b797-d284789bbdc6 for instance b3166329-2bc2-4aea-983b-a8e05ff43d38 on hv-cinder-84456 Aug 03 10:05:37.746761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-d6407f00-fe15-4c29-9d03-ee1b86299d26 req-27446460-3b79-498f-90b3-b4bf218bc24f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109655 Aug 03 10:05:37.748215 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1519/3160] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:37.798801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-97fac912-8a2f-49e7-b93d-034bda22ddb8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.068613 Aug 03 10:05:37.799832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1642/3161] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 10:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:05:37.811963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-baf54590-6d0d-4def-af25-972a339ed1aa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:37.812686 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-baf54590-6d0d-4def-af25-972a339ed1aa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:37.907434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-baf54590-6d0d-4def-af25-972a339ed1aa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:37.915963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-baf54590-6d0d-4def-af25-972a339ed1aa tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1219 microversion: 2.1 time: 0.108747 Aug 03 10:05:37.918641 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1520/3162] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:37 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:38.640501 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:38.641297 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: b3166329-2bc2-4aea-983b-a8e05ff43d38] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:38.659660 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.660410 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.661476 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.663359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.694507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 HTTP/1.1 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:38.696787 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. Aug 03 10:05:38.698687 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'b3166329-2bc2-4aea-983b-a8e05ff43d38'} Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:38.699560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. Aug 03 10:05:38.701760 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:38.703905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 404 to user: Instance b3166329-2bc2-4aea-983b-a8e05ff43d38 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:38.703905 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e55904c4-3407-4589-9ce5-eb0bbf50d4d6 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38" status: 404 len: 111 microversion: 2.1 time: 0.066838 Aug 03 10:05:38.704482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1643/3163] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:38 2022] GET /compute/v2.1/servers/b3166329-2bc2-4aea-983b-a8e05ff43d38 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:38.712798 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:38.713509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:38.724420 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.724892 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.728303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.730961 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.790934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:05:38.936525 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:38.937405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:38.950548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.952975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.954326 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:38.955077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:38.999438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ee12700-a6fe-42fe-a5c2-c99269d9ab31 tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "DELETE /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 204 len: 0 microversion: 2.1 time: 0.290893 Aug 03 10:05:39.011489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1521/3164] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:05:38 2022] DELETE /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:05:39.024984 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:39.025994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:39.038819 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:39.040087 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:39.047784 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:39.048986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:39.050208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:39.059994 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-90afab39-5684-4cd9-9c11-6ab81ea45d56 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1223 microversion: 2.1 time: 0.127351 Aug 03 10:05:39.065739 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1644/3165] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:38 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:05:39.315751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:39.330567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-96d1bde5-1b0e-4db4-8d76-538910997ead tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1520 microversion: 2.1 time: 0.314680 Aug 03 10:05:39.338308 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1522/3166] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:39 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:05:40.086948 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:40.087520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:40.105342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.105871 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.106682 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.107126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.175808 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-3567f1cd-fb8b-4968-ad8b-f1dc24db9268 req-910932cf-9394-4f32-8935-acd7f1b4420d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "708ec0aa-3818-45fd-9be1-1832b91abdbc", "name": "network-vif-deleted", "tag": "a6eb1086-96d4-48f1-ba49-b2cdf68828f9"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:40.191093 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3567f1cd-fb8b-4968-ad8b-f1dc24db9268 req-910932cf-9394-4f32-8935-acd7f1b4420d service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.191527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-3567f1cd-fb8b-4968-ad8b-f1dc24db9268 req-910932cf-9394-4f32-8935-acd7f1b4420d service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.216994 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-3567f1cd-fb8b-4968-ad8b-f1dc24db9268 req-910932cf-9394-4f32-8935-acd7f1b4420d service nova] Creating event network-vif-deleted:a6eb1086-96d4-48f1-ba49-b2cdf68828f9 for instance 708ec0aa-3818-45fd-9be1-1832b91abdbc on hv-cinder-84456 Aug 03 10:05:40.227758 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:40.238258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bf7605ed-0d4f-47bd-8d5e-67579d8f36b8 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1277 microversion: 2.1 time: 0.155854 Aug 03 10:05:40.241906 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-3567f1cd-fb8b-4968-ad8b-f1dc24db9268 req-910932cf-9394-4f32-8935-acd7f1b4420d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067645 Aug 03 10:05:40.246764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1523/3167] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:05:40.255555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1645/3168] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:40 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:40.356674 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:40.357645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:40.375631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.376133 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.377036 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.377473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.433451 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:40.434221 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:40.434833 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lazy-loading 'fault' on Instance uuid 708ec0aa-3818-45fd-9be1-1832b91abdbc {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:05:40.500021 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f366a30f465b4dbea0dfa9a8e5f0a15c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79dda421f5ac471e8096942dcc4cedf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:40.514091 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e449c798-fa29-456c-8754-20508d7f342b tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 200 len: 1311 microversion: 2.1 time: 0.161156 Aug 03 10:05:40.516699 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1524/3169] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:40 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:41.046442 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7db557b8-b9c6-4205-8363-6f258b21dbb9 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Action: 'create', calling method: .version_select at 0x7fb99d4e7d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-130206809", "metadata": {"Type": "work"}}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:41.260905 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:41.262286 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:41.268713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:41.271366 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:41.272585 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:41.277056 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:41.501371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:41.514842 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7fe7699b-1778-4b67-9946-8c715f94fc1e tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.256860 Aug 03 10:05:41.519161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1525/3170] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:41 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:41.520843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7db557b8-b9c6-4205-8363-6f258b21dbb9 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.668949 Aug 03 10:05:41.522068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1646/3171] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 3 10:05:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 03 10:05:41.537305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-19b0b4ae-69f7-4444-8f0c-c04af478474c tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb998b03c10>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:41.545868 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:41.550489 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] [instance: 708ec0aa-3818-45fd-9be1-1832b91abdbc] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:41.567292 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:41.567735 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:41.568496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:41.568960 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:41.607477 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] HTTP exception thrown: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Request method failure captured: Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc HTTP/1.1 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kA9O4_XTos76A_dI5oxYREr795fTGt-OQwG7cHDWlk-ImKziTi4Mw9CLwDvb05hJRfex_dAbmsYYAxmztGUgtXLchDjetNF_yR1QsR4dlfyDPGT_atpFoVPdlXZbGjv4uA_v0a8VZBEKwjzumXIzHtbBbDEGz7Fzsxh76tA46EzwJc Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:41.609172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_79dda421f5ac471e8096942dcc4cedf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/79dda421f5ac471e8096942dcc4cedf5"}]}] Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 79dda421f5ac471e8096942dcc4cedf5 Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1255087555 Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: f366a30f465b4dbea0dfa9a8e5f0a15c Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1255087555-project Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. Aug 03 10:05:41.610702 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '708ec0aa-3818-45fd-9be1-1832b91abdbc'} Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:41.611615 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. Aug 03 10:05:41.613031 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:41.614325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] Returning 404 to user: Instance 708ec0aa-3818-45fd-9be1-1832b91abdbc could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:41.614325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1ab621bf-e6e1-4021-b787-b734f6a98e1d tempest-ServerRescueNegativeTestJSON-1255087555 tempest-ServerRescueNegativeTestJSON-1255087555-project] 10.222.0.20 "GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc" status: 404 len: 111 microversion: 2.1 time: 0.076199 Aug 03 10:05:41.614325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1647/3172] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:41 2022] GET /compute/v2.1/servers/708ec0aa-3818-45fd-9be1-1832b91abdbc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:41.648371 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-19b0b4ae-69f7-4444-8f0c-c04af478474c tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 200 len: 352 microversion: 2.1 time: 0.117341 Aug 03 10:05:41.649000 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1526/3173] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:41 2022] GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:41.855859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-16a96375-a05e-4f99-8dae-c8bdfc6a4409 req-a3f7834d-aeae-4397-acdb-d656d7208e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aca62243-f95b-4e33-92de-9d9a16c147f9", "tag": "1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:41.888866 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-16a96375-a05e-4f99-8dae-c8bdfc6a4409 req-a3f7834d-aeae-4397-acdb-d656d7208e26 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:41.889299 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-16a96375-a05e-4f99-8dae-c8bdfc6a4409 req-a3f7834d-aeae-4397-acdb-d656d7208e26 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:41.916052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-16a96375-a05e-4f99-8dae-c8bdfc6a4409 req-a3f7834d-aeae-4397-acdb-d656d7208e26 service nova] Creating event network-changed:1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24 for instance aca62243-f95b-4e33-92de-9d9a16c147f9 on hv-cinder-84456 Aug 03 10:05:41.924023 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-16a96375-a05e-4f99-8dae-c8bdfc6a4409 req-a3f7834d-aeae-4397-acdb-d656d7208e26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072726 Aug 03 10:05:41.926192 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1648/3174] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:42.538295 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:42.541025 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:42.549832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:42.550596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:42.551809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:42.553489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:42.665838 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1556a614-7127-4254-8240-58b597d90008 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb99d4e73a0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:42.710460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:42.723525 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b58a1c74-c5c3-48fc-9066-7f685ef38828 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.190298 Aug 03 10:05:42.737684 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1527/3175] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:42 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:42.750892 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1556a614-7127-4254-8240-58b597d90008 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 200 len: 353 microversion: 2.1 time: 0.091583 Aug 03 10:05:42.751463 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1649/3176] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:42 2022] GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:05:42.765235 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f84d7215-0ef9-4ed5-ab19-5f647c0d06cf tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb998c8f040>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:42.819581 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f84d7215-0ef9-4ed5-ab19-5f647c0d06cf tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 200 len: 353 microversion: 2.1 time: 0.059415 Aug 03 10:05:42.821460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1528/3177] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:42 2022] GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:42.841249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-149e11ca-4b75-4546-b2dd-e9adb7040f21 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb9995fb3a0>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:42.920585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-149e11ca-4b75-4546-b2dd-e9adb7040f21 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 202 len: 0 microversion: 2.1 time: 0.083793 Aug 03 10:05:42.921516 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1650/3178] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 10:05:42 2022] DELETE /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:05:42.929148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-2b382065-4504-4d1f-a1ca-41fd4b669bd4 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb998b03940>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:43.027407 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-2b382065-4504-4d1f-a1ca-41fd4b669bd4 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 200 len: 352 microversion: 2.1 time: 0.101973 Aug 03 10:05:43.028265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1529/3179] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:42 2022] GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:43.549514 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:05:43.550196 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:05:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:05:43.747769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:43.748612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:43.770497 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:43.771431 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:43.772208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:43.776845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:43.988021 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:44.000375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-bf476a74-64d8-41dc-92de-ae9a0b2cf976 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.256895 Aug 03 10:05:44.000375 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1651/3180] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:43 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:44.042803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4794ca22-1b7d-4387-9452-28fadc7a3309 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Calling method '.version_select at 0x7fb998b334c0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:44.082852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-4794ca22-1b7d-4387-9452-28fadc7a3309 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] HTTP exception thrown: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4794ca22-1b7d-4387-9452-28fadc7a3309 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Request method failure captured: Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 HTTP/1.1 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kh0LjBLM-kXDDivXhbXm6AJc4JQnqyvh00190sgmlqkLIOJnUUfKEe0tO8Yn4EoOU297gRuSUTko0Vot0XytuZHVbgFzGhnnXcjbzYdB2eLGyUKMa1WDLk-8SwWRoWIXHvaW5gD7PLe-aonDUBp23C6PHistN2PSPOZ9MpAuyTOCG8 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 6ea26ee67fac4a62ae0f62dd418a5d9b Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesGetTestJSON-168159524 Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:05:44.085441 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6ea26ee67fac4a62ae0f62dd418a5d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ea26ee67fac4a62ae0f62dd418a5d9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6ea26ee67fac4a62ae0f62dd418a5d9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6ea26ee67fac4a62ae0f62dd418a5d9b"}]}] Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesGetTestJSON-168159524 Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 6ea26ee67fac4a62ae0f62dd418a5d9b Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesGetTestJSON-168159524 Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesGetTestJSON-168159524-project Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 760f548960364d35b10fff77a32ae686 Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesGetTestJSON-168159524-project Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '39bcb501-e395-4452-af10-284a4e51da16'} Aug 03 10:05:44.087651 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. (HTTP 404) (Request-ID: req-ecf04ad9-cf56-4c4a-80f2-31c37c327bf0) Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:44.088620 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:05:44.090879 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:05:44.093183 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4794ca22-1b7d-4387-9452-28fadc7a3309 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] Returning 404 to user: Volume 39bcb501-e395-4452-af10-284a4e51da16 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4794ca22-1b7d-4387-9452-28fadc7a3309 tempest-VolumesGetTestJSON-168159524 tempest-VolumesGetTestJSON-168159524-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16" status: 404 len: 109 microversion: 2.1 time: 0.049914 Aug 03 10:05:44.095450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1530/3181] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:44 2022] GET /compute/v2.1/os-volumes/39bcb501-e395-4452-af10-284a4e51da16 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:45.019530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:45.020231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:45.027563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:45.028112 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:45.028992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:45.029485 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:45.252188 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:45.262329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-af8a6ef6-3cc5-4b9a-9c01-ee6defa25702 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.246600 Aug 03 10:05:45.263674 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1652/3182] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:45 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:46.284637 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:46.285476 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:46.293316 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:46.293848 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:46.294782 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:46.295432 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:46.455472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:46.466014 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-bc864993-005b-47da-8185-70549813d735 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.183949 Aug 03 10:05:46.477461 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1531/3183] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:46 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:47.489840 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:47.490980 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:47.501465 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:47.502050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:47.504418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:47.505331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:47.583403 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:47.644520 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-c7d13139-5a51-4098-98f9-3ce983c35df2 req-8f7b3336-7ecf-492d-9896-a24fb701d4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca62243-f95b-4e33-92de-9d9a16c147f9", "name": "network-vif-plugged", "status": "completed", "tag": "1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:47.660287 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:47.670137 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c7d13139-5a51-4098-98f9-3ce983c35df2 req-8f7b3336-7ecf-492d-9896-a24fb701d4ce service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:47.671193 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-c7d13139-5a51-4098-98f9-3ce983c35df2 req-8f7b3336-7ecf-492d-9896-a24fb701d4ce service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:47.690961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-c7d13139-5a51-4098-98f9-3ce983c35df2 req-8f7b3336-7ecf-492d-9896-a24fb701d4ce service nova] Creating event network-vif-plugged:1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24 for instance aca62243-f95b-4e33-92de-9d9a16c147f9 on hv-cinder-84456 Aug 03 10:05:47.699386 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-c7d13139-5a51-4098-98f9-3ce983c35df2 req-8f7b3336-7ecf-492d-9896-a24fb701d4ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310642 Aug 03 10:05:47.700638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1653/3184] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:05:47.738577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:47.747325 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a15505eb-1a78-40e0-a453-06e55d5421b0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.263453 Aug 03 10:05:47.748483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1532/3185] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:47 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:48.271133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a21086b-bd79-4be1-ba3f-a049f1a510a3 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Action: 'create', calling method: .version_select at 0x7fb9995fbd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-9057780", "metadata": {"Type": "work"}}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a21086b-bd79-4be1-ba3f-a049f1a510a3 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 119 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:48.295258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-9057780", "metadata": {"Type": "work"}}} Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 10:05:48.297162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-9057780', 'metadata': {'Type': 'work'}}}} Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi '#$%' Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.298433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:05:48.300235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:05:48.301988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 03 10:05:48.301988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.301988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9a21086b-bd79-4be1-ba3f-a049f1a510a3 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.301988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9a21086b-bd79-4be1-ba3f-a049f1a510a3 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.208462 Aug 03 10:05:48.301988 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1654/3186] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 3 10:05:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:05:48.306885 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df438d60-86f6-45b5-ae54-12877d11d9e0 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Action: 'create', calling method: .version_select at 0x7fb998a8e430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1713531019", "metadata": {"Type": "work"}}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df438d60-86f6-45b5-ae54-12877d11d9e0 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 120 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:05:48.311359 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1713531019", "metadata": {"Type": "work"}}} Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: Aug 03 10:05:48.313211 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1713531019', 'metadata': {'Type': 'work'}}}} Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi '0' Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.314541 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:05:48.316527 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:05:48.323411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 03 10:05:48.323411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.323411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df438d60-86f6-45b5-ae54-12877d11d9e0 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.323411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df438d60-86f6-45b5-ae54-12877d11d9e0 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010404 Aug 03 10:05:48.323411 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1533/3187] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 3 10:05:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:05:48.323859 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04da41a5-6059-4ea3-a063-ea3b3654c9cf tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Action: 'create', calling method: .version_select at 0x7fb99d3eb9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-231775328", "metadata": {"Type": "work"}}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04da41a5-6059-4ea3-a063-ea3b3654c9cf tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 118 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:48.325955 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-231775328", "metadata": {"Type": "work"}}} Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 10:05:48.327715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-231775328', 'metadata': {'Type': 'work'}}}} Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise error Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi '' Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.328806 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 03 10:05:48.330709 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 03 10:05:48.332131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 03 10:05:48.332131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.332131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-04da41a5-6059-4ea3-a063-ea3b3654c9cf tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.332131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-04da41a5-6059-4ea3-a063-ea3b3654c9cf tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009352 Aug 03 10:05:48.332131 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1655/3188] 10.222.0.20 () {60 vars in 1156 bytes} [Wed Aug 3 10:05:48 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 03 10:05:48.339489 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3755a9bc-d6d4-4c69-90b3-26ce5c7444f4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Calling method '.version_select at 0x7fb998b24e50>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:48.345636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:48.369965 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-3755a9bc-d6d4-4c69-90b3-26ce5c7444f4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] HTTP exception thrown: Volume tempest-invalid-1512675958 could not be found. Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3755a9bc-d6d4-4c69-90b3-26ce5c7444f4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1512675958 HTTP/1.1 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:05:48.372701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Volume tempest-invalid-1512675958 could not be found. Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': 'tempest-invalid-1512675958'} Aug 03 10:05:48.374551 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1512675958 could not be found. (HTTP 404) (Request-ID: req-e1e56764-79a5-490d-b75b-d2f728b24ef2) Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.375908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:05:48.377613 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1512675958 could not be found. Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:48.378941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1512675958 could not be found. Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1512675958 could not be found. Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3755a9bc-d6d4-4c69-90b3-26ce5c7444f4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 404 to user: Volume tempest-invalid-1512675958 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3755a9bc-d6d4-4c69-90b3-26ce5c7444f4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1512675958" status: 404 len: 99 microversion: 2.1 time: 0.041641 Aug 03 10:05:48.380395 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1534/3189] 10.222.0.20 () {58 vars in 1218 bytes} [Wed Aug 3 10:05:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1512675958 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 03 10:05:48.386584 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e7a38b6c-d380-4dd0-824a-b72123738dc4 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004045 Aug 03 10:05:48.387078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1656/3190] 10.222.0.20 () {58 vars in 1140 bytes} [Wed Aug 3 10:05:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 10:05:48.396940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d865dc54-0ae2-4b82-8f8f-de1e4281b573 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004122 Aug 03 10:05:48.397652 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1535/3191] 10.222.0.20 () {58 vars in 1137 bytes} [Wed Aug 3 10:05:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 03 10:05:48.407351 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d30ed47a-db50-4bb1-88c6-398282ee0bf6 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Calling method '.version_select at 0x7fb998ce3550>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:48.437521 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-d30ed47a-db50-4bb1-88c6-398282ee0bf6 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] HTTP exception thrown: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d30ed47a-db50-4bb1-88c6-398282ee0bf6 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: DELETE /compute/v2.1/os-volumes/3caac45e-1786-411a-8123-c3d088e0deff HTTP/1.1 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:05:48.439609 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '3caac45e-1786-411a-8123-c3d088e0deff'} Aug 03 10:05:48.441177 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. (HTTP 404) (Request-ID: req-ad9d9859-e328-454f-9bcd-437ae206bef5) Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.442508 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 03 10:05:48.444135 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 03 10:05:48.447055 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d30ed47a-db50-4bb1-88c6-398282ee0bf6 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 404 to user: Volume 3caac45e-1786-411a-8123-c3d088e0deff could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d30ed47a-db50-4bb1-88c6-398282ee0bf6 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3caac45e-1786-411a-8123-c3d088e0deff" status: 404 len: 109 microversion: 2.1 time: 0.037907 Aug 03 10:05:48.448993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1657/3192] 10.222.0.20 () {58 vars in 1248 bytes} [Wed Aug 3 10:05:48 2022] DELETE /compute/v2.1/os-volumes/3caac45e-1786-411a-8123-c3d088e0deff => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:48.454138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b088662a-3e40-437d-bdce-0e85ee2fabd5 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Calling method '.version_select at 0x7fb998a8a3a0>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:48.481775 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-b088662a-3e40-437d-bdce-0e85ee2fabd5 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] HTTP exception thrown: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b088662a-3e40-437d-bdce-0e85ee2fabd5 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Request method failure captured: Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/os-volumes/2086c1ba-f600-450a-a690-8b2a62984044 HTTP/1.1 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kh7dJZp9ejY6NeX5w_7iXWXDWSt8PQfWAAA2lrHw693V5qgVpH5rxFHK41NtC6Ml8NX8426-fMRGsujd6OkvzTHSoCZPoR_o5po_DlsJ07v8M61MjDkvnWz_In4oPPaXlKQ-SMLm-XCKzNJifBAoABKl8LxisKihXmPnVrz7zKgIbw Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:05:48.483721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_71b515d4106148d88fbcee4c643bdbf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/71b515d4106148d88fbcee4c643bdbf3"}]}] Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 71b515d4106148d88fbcee4c643bdbf3 Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesNegativeTest-1353111963 Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 72a5e28e35f049fcb15973c80f69c169 Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesNegativeTest-1353111963-project Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '2086c1ba-f600-450a-a690-8b2a62984044'} Aug 03 10:05:48.485530 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. (HTTP 404) (Request-ID: req-d9716d4c-d277-4d1e-92e2-d312839fbdc3) Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.486645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 03 10:05:48.488252 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 03 10:05:48.489822 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b088662a-3e40-437d-bdce-0e85ee2fabd5 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] Returning 404 to user: Volume 2086c1ba-f600-450a-a690-8b2a62984044 could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b088662a-3e40-437d-bdce-0e85ee2fabd5 tempest-VolumesNegativeTest-1353111963 tempest-VolumesNegativeTest-1353111963-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2086c1ba-f600-450a-a690-8b2a62984044" status: 404 len: 109 microversion: 2.1 time: 0.034846 Aug 03 10:05:48.491832 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1536/3193] 10.222.0.20 () {58 vars in 1245 bytes} [Wed Aug 3 10:05:48 2022] GET /compute/v2.1/os-volumes/2086c1ba-f600-450a-a690-8b2a62984044 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:05:48.769697 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:48.770439 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:48.780182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:48.781325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:48.782507 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:48.783185 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:48.965663 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:48.973773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-0b82679f-4403-4c3b-b730-23b1797c45ea tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1319 microversion: 2.1 time: 0.207814 Aug 03 10:05:48.975401 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1658/3194] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:48 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:49.996923 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:05:49.997616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:50.003989 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:50.004434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:50.005214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:50.005642 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:50.143108 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:05:50.146542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:05:50.152428 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c9b8be97-8299-4722-947c-bf93887559f6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1507 microversion: 2.1 time: 0.160842 Aug 03 10:05:50.153023 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1537/3195] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:05:49 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:05:50.172765 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b69c3f3-2817-4a69-9d11-df0ced86043e", "device": "/dev/sdb"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:05:50.176364 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:05:50.184147 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:50.184585 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:50.185385 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:05:50.186049 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:05:50.454518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-161f61ad-61f0-40c8-8bf1-3f690828d230 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "POST /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285720 Aug 03 10:05:50.455113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1659/3196] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 10:05:50 2022] POST /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:13.440633 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:13.442130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:13.447738 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:13.454385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:13.454887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:13.455627 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:13.456008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:13.555936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'services' on Instance uuid aca62243-f95b-4e33-92de-9d9a16c147f9 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:06:13.635233 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b29fc0c7-8971-4233-8202-12dc0f6797c1 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9/os-volume_attachments/7b69c3f3-2817-4a69-9d11-df0ced86043e" status: 202 len: 0 microversion: 2.1 time: 0.198666 Aug 03 10:06:13.635829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1538/3197] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 10:06:13 2022] DELETE /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9/os-volume_attachments/7b69c3f3-2817-4a69-9d11-df0ced86043e => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:06:14.770064 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:14.771232 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:14.776587 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:14.777189 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:14.785626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:14.786072 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:14.786938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:14.787249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:14.815845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:06:14.900300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3347db31-bf62-47fd-94c3-f8198337175b tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 204 len: 0 microversion: 2.1 time: 0.131488 Aug 03 10:06:14.900961 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1660/3198] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:06:14 2022] DELETE /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 03 10:06:14.909596 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:14.910907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:14.918521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:14.918963 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:14.919727 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:14.920157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:15.102311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:15.110729 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-521c1e59-2a0c-4dcc-b527-246ed4a1441a tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.205180 Aug 03 10:06:15.111279 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1539/3199] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:14 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:16.134748 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:16.135564 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:16.144249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:16.144249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:16.144249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:16.144249 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:16.285662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:16.293713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9c0b4345-64ec-48fa-9191-5898af7c0001 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.163560 Aug 03 10:06:16.294381 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1661/3200] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:16 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:17.314475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:17.315179 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:17.322694 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:17.323138 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:17.323887 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:17.324317 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:17.459181 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:17.466707 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-961e6e48-fa44-4d45-9335-86eb6391db13 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.156104 Aug 03 10:06:17.467274 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1540/3201] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:17 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:18.369946 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1829495163", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "networks": [{"uuid": "b7847bd7-ff0b-4acd-b98d-aaee1df1c755"}]}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:18.424296 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.network.neutron [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] validate_networks() for [('b7847bd7-ff0b-4acd-b98d-aaee1df1c755', None, None, None, None, None)] {{(pid=117929) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:06:18.487724 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:18.488418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:18.495503 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:18.496039 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:18.496884 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:18.497379 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:18.633092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:18.641943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a71f5cc4-f5c5-41cb-8463-d9c0dfe5bbf2 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.158171 Aug 03 10:06:18.642454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1541/3202] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:18 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:06:18.903914 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Flavor limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:06:18.904488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Image limits 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:06:18.904992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Flavor pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:06:18.905400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Image pref 0:0:0 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:06:18.905805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.virt.hardware [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:06:18.915908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:18.916828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:18.917690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:18.918235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:18.935989 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Getting quotas for project 45e76f564d954f18aff24f9d1066f3de. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:06:18.939881 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Getting quotas for user 60483d6df5444b3abf3ff3402d7335e8 and project 45e76f564d954f18aff24f9d1066f3de. Resources: {'ram', 'instances', 'cores'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:06:18.951278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Going to run 1 instances... {{(pid=117929) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:06:18.953543 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117929) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:06:19.002366 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-54fabc6e-9847-473f-b6a1-be732b433f76 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637284 Aug 03 10:06:19.003400 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1662/3203] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 10:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:06:19.013952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a9cead39-6bea-4d70-83d2-2c4dde16e88c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:19.014567 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a9cead39-6bea-4d70-83d2-2c4dde16e88c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:19.083617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a9cead39-6bea-4d70-83d2-2c4dde16e88c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:19.092509 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a9cead39-6bea-4d70-83d2-2c4dde16e88c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1214 microversion: 2.1 time: 0.082439 Aug 03 10:06:19.093124 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1542/3204] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:19 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:19.664070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:19.664581 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:19.671206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:19.671649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:19.672405 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:19.672852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:19.808271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:19.815834 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-45f6b363-172b-4fcd-89fb-1695ff510aae tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.156418 Aug 03 10:06:19.816399 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1663/3205] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:19 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:20.114877 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:20.115667 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:20.122529 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:20.122995 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:20.123749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:20.124175 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:20.186710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:20.194764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a7d90033-40e0-4a52-bfec-9979fe02f51d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1218 microversion: 2.1 time: 0.083065 Aug 03 10:06:20.195330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1543/3206] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:20 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:20.838837 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:20.839496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:20.846848 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:20.847295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:20.848173 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:20.848781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:20.994461 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:21.001945 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7235c52a-81b8-4c68-93da-cfcaa16c96c6 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1513 microversion: 2.1 time: 0.167824 Aug 03 10:06:21.002502 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1664/3207] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:20 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:21.219117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:21.219938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:21.232975 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:21.233423 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:21.234193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:21.234621 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:21.373908 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:21.383123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b07678ef-6f36-4de3-9cec-719545bc1e1f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1274 microversion: 2.1 time: 0.168741 Aug 03 10:06:21.385152 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1544/3208] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:21 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:21.590976 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-2fd0eb9c-5cb3-47b5-8b16-542ebf0febb2 req-538378ab-0ee6-49cb-a136-0e36672b151e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aca62243-f95b-4e33-92de-9d9a16c147f9", "name": "network-vif-deleted", "tag": "1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:21.610726 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-2fd0eb9c-5cb3-47b5-8b16-542ebf0febb2 req-538378ab-0ee6-49cb-a136-0e36672b151e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:21.611172 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-2fd0eb9c-5cb3-47b5-8b16-542ebf0febb2 req-538378ab-0ee6-49cb-a136-0e36672b151e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:21.626474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-2fd0eb9c-5cb3-47b5-8b16-542ebf0febb2 req-538378ab-0ee6-49cb-a136-0e36672b151e service nova] Creating event network-vif-deleted:1be7c99f-90ca-4ea8-bb1b-8125bf0e8a24 for instance aca62243-f95b-4e33-92de-9d9a16c147f9 on hv-cinder-84456 Aug 03 10:06:21.641183 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-2fd0eb9c-5cb3-47b5-8b16-542ebf0febb2 req-538378ab-0ee6-49cb-a136-0e36672b151e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061455 Aug 03 10:06:21.645673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1665/3209] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:22.024265 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:22.025151 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:22.031764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.032396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.033385 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.033990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.073464 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.074311 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.074762 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lazy-loading 'fault' on Instance uuid aca62243-f95b-4e33-92de-9d9a16c147f9 {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:06:22.135231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bc1f887a65c4473bed69bed5dc8fe9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e4ee6e1000f4a87a92c3c34d1432cdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:22.144193 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7eed774f-02f8-4638-a2a8-57bda7bc7ab0 tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 200 len: 1309 microversion: 2.1 time: 0.124307 Aug 03 10:06:22.144757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1545/3210] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:22 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 1309 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:22.407164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:22.407862 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:22.415397 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.415965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.417138 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.417921 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.626196 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:22.639789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d0da3813-0203-403c-9cc3-f79b1765cfd4 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.236959 Aug 03 10:06:22.643690 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1666/3211] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:22 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:22.705878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-0f64d664-9f8a-4358-b7f5-ad81e5015ae5 req-99580e57-5e1f-45c7-83ae-6a72783e4b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8ffb87-f394-456e-a436-d89b2eb6eb98", "tag": "27fc5873-ec35-4bac-84c6-d94cd83ef196"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:22.718450 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0f64d664-9f8a-4358-b7f5-ad81e5015ae5 req-99580e57-5e1f-45c7-83ae-6a72783e4b44 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:22.719154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-0f64d664-9f8a-4358-b7f5-ad81e5015ae5 req-99580e57-5e1f-45c7-83ae-6a72783e4b44 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:22.734305 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-0f64d664-9f8a-4358-b7f5-ad81e5015ae5 req-99580e57-5e1f-45c7-83ae-6a72783e4b44 service nova] Creating event network-changed:27fc5873-ec35-4bac-84c6-d94cd83ef196 for instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 on hv-cinder-84456 Aug 03 10:06:22.739964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-0f64d664-9f8a-4358-b7f5-ad81e5015ae5 req-99580e57-5e1f-45c7-83ae-6a72783e4b44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037697 Aug 03 10:06:22.740766 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1546/3212] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:06:23.166235 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:23.166850 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] [instance: aca62243-f95b-4e33-92de-9d9a16c147f9] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:23.174011 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:23.174951 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:23.175891 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:23.176424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:23.192191 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] HTTP exception thrown: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Request method failure captured: Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 HTTP/1.1 Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kDs3VaySaYdUT1NNDX4RKHPJjOvHmvIh57zvH1dU-nYQZ0ZtvJy2Cob0_2TVI8IgnyHJJ4eTSTGOYkq4wal_nM1ZDCLNxGYz8r_LdtoRNMwVLIDHHZ_DZ19iV7uTI-5FtBmqJ_UxBkB3-Cvp6CRdQfvy_UsOBJGs1lpeBSh97jR5pM Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:06:23.194009 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7e4ee6e1000f4a87a92c3c34d1432cdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7e4ee6e1000f4a87a92c3c34d1432cdf"}]}] Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 7e4ee6e1000f4a87a92c3c34d1432cdf Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1033521212 Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 5bc1f887a65c4473bed69bed5dc8fe9f Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesSnapshotTestJSON-1033521212-project Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. Aug 03 10:06:23.196648 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': 'aca62243-f95b-4e33-92de-9d9a16c147f9'} Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:06:23.197993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. Aug 03 10:06:23.199809 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:23.201432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] Returning 404 to user: Instance aca62243-f95b-4e33-92de-9d9a16c147f9 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:06:23.201432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-43d1e8ad-f817-475c-9d6f-1bf7df12dbed tempest-VolumesSnapshotTestJSON-1033521212 tempest-VolumesSnapshotTestJSON-1033521212-project] 10.222.0.20 "GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9" status: 404 len: 111 microversion: 2.1 time: 0.034820 Aug 03 10:06:23.201432 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1667/3213] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:23 2022] GET /compute/v2.1/servers/aca62243-f95b-4e33-92de-9d9a16c147f9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:06:23.667353 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:23.668047 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:23.674161 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:23.674605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:23.675356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:23.675787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:23.813754 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:23.822987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-e7b7d9cf-f98f-4a01-a759-b794af921a1a tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.160064 Aug 03 10:06:23.823645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1547/3214] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:23 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:24.845182 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:24.845827 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:24.852984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:24.853433 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:24.854200 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:24.854832 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:24.997014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:25.005251 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-38e9979a-463d-414a-9eb1-0bbaec96ab58 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.163978 Aug 03 10:06:25.005828 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1668/3215] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:24 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:06:26.028061 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:26.028771 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:26.044097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:26.044803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:26.045594 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:26.046028 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:26.231648 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:26.239092 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b2f8bee2-6338-404a-99f0-ad072e2ee917 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.215827 Aug 03 10:06:26.239791 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1548/3216] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:26 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:27.260943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:27.261560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:27.267943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:27.268388 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:27.269168 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:27.269601 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:27.396208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:27.403652 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-107c2a4d-5472-4408-8d8c-a6a9ce390ffd tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.148073 Aug 03 10:06:27.404214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1669/3217] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:27 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:28.430202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:28.430202 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:28.433554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:28.434075 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:28.434946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:28.435578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:28.567938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:28.575935 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-9fa1bbf3-f9c1-4b59-8f54-7207fb400cda tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.154758 Aug 03 10:06:28.576500 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1549/3218] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:28 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:29.597206 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:29.597845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:29.600742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:29.601441 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:29.607310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:29.607759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:29.608541 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:29.609016 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:29.738557 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:29.746860 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e720b2fb-cf55-4375-a009-9a70e790f4a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.153524 Aug 03 10:06:29.747421 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1670/3219] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:29 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:29.921712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-5d762a38-00c3-4f56-be0d-5ab99f6f4456 req-d60be712-4cd7-4a85-b49a-97929db63ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8ffb87-f394-456e-a436-d89b2eb6eb98", "name": "network-vif-plugged", "status": "completed", "tag": "27fc5873-ec35-4bac-84c6-d94cd83ef196"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:29.926618 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:29.933689 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-5d762a38-00c3-4f56-be0d-5ab99f6f4456 req-d60be712-4cd7-4a85-b49a-97929db63ae3 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:29.934123 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-5d762a38-00c3-4f56-be0d-5ab99f6f4456 req-d60be712-4cd7-4a85-b49a-97929db63ae3 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:29.946400 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-5d762a38-00c3-4f56-be0d-5ab99f6f4456 req-d60be712-4cd7-4a85-b49a-97929db63ae3 service nova] Creating event network-vif-plugged:27fc5873-ec35-4bac-84c6-d94cd83ef196 for instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 on hv-cinder-84456 Aug 03 10:06:29.951610 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-5d762a38-00c3-4f56-be0d-5ab99f6f4456 req-d60be712-4cd7-4a85-b49a-97929db63ae3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Aug 03 10:06:29.952209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1550/3220] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:30.768105 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:30.768671 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:30.775852 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:30.776295 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:30.777070 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:30.777500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:30.915301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:30.922617 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-427ec3cc-2a4a-4a0b-90c1-de0df54d163c tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.158433 Aug 03 10:06:30.923174 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1671/3221] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:30 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:31.945141 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:31.945895 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:31.952172 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:31.952611 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:31.953390 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:31.953818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:32.265744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:32.273050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-95088557-89ae-4dec-a13d-a302fbc8f09d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1314 microversion: 2.1 time: 0.333128 Aug 03 10:06:32.273602 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1551/3222] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:31 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:33.293741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:33.294359 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:33.300937 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:33.301430 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:33.302151 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:33.302621 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:33.447362 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:33.455402 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-17a97a6a-ef2c-4b15-aef4-a07ad224755e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1497 microversion: 2.1 time: 0.165439 Aug 03 10:06:33.455977 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1672/3223] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:33 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:33.902054 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:33.902589 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:33.909125 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:33.909571 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:33.910330 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:33.910764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:33.937513 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Going to try to terminate instance {{(pid=117928) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:06:34.017415 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3b444e9d-7b29-423f-a55b-1e6a4958d07b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 204 len: 0 microversion: 2.1 time: 0.119166 Aug 03 10:06:34.018058 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1552/3224] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:06:33 2022] DELETE /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:06:34.026472 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:34.027117 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:34.034398 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:34.034844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:34.035602 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:34.036035 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:34.181078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:34.189419 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b8a08fbd-a05b-4465-948d-c54e015c6d5f tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1503 microversion: 2.1 time: 0.167132 Aug 03 10:06:34.189985 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1673/3225] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:34 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:35.211154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:35.211794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:35.218117 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:35.218557 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:35.219331 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:35.219757 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:35.377223 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:35.385437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-65b0d9db-7436-4161-9bbd-757316df4071 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1503 microversion: 2.1 time: 0.178629 Aug 03 10:06:35.386072 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1553/3226] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:35 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:36.406523 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:36.407241 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:36.413882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:36.414328 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:36.415089 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:36.415515 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:36.557612 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:36.568113 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a023e44-3e14-4ef6-a960-98306d3471b7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1503 microversion: 2.1 time: 0.165388 Aug 03 10:06:36.569883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1674/3227] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:36 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:37.591298 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:37.591818 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:37.598273 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:37.598713 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:37.599643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:37.600114 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:37.604140 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:37.740731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:37.749084 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-85f2e868-2065-4dd1-9ea0-c2aa2e86f623 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1503 microversion: 2.1 time: 0.161667 Aug 03 10:06:37.749787 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1554/3228] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:37 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:38.769925 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:38.770548 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:38.777631 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:38.778332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:38.779107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:38.779545 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:38.912424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:38.919966 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-612cd492-f86a-46dc-87d8-8eb04a4337f2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1503 microversion: 2.1 time: 0.153870 Aug 03 10:06:38.920845 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1675/3229] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:38 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:39.740650 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-06d3ab90-0e21-4ea5-aa86-a01381ea2331 req-89c986d6-f8a9-4a22-87c5-3091e92ce8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8ffb87-f394-456e-a436-d89b2eb6eb98", "name": "network-vif-unplugged", "status": "completed", "tag": "27fc5873-ec35-4bac-84c6-d94cd83ef196"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:39.754608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-06d3ab90-0e21-4ea5-aa86-a01381ea2331 req-89c986d6-f8a9-4a22-87c5-3091e92ce8c4 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:39.755136 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-06d3ab90-0e21-4ea5-aa86-a01381ea2331 req-89c986d6-f8a9-4a22-87c5-3091e92ce8c4 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:39.766909 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-06d3ab90-0e21-4ea5-aa86-a01381ea2331 req-89c986d6-f8a9-4a22-87c5-3091e92ce8c4 service nova] Creating event network-vif-unplugged:27fc5873-ec35-4bac-84c6-d94cd83ef196 for instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 on hv-cinder-84456 Aug 03 10:06:39.772534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-06d3ab90-0e21-4ea5-aa86-a01381ea2331 req-89c986d6-f8a9-4a22-87c5-3091e92ce8c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034981 Aug 03 10:06:39.773659 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1555/3230] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:06:39.909882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-4403a7d1-480c-430b-9405-128326f30dda req-7576d882-34f1-4748-b356-850affb2d38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8ffb87-f394-456e-a436-d89b2eb6eb98", "name": "network-vif-deleted", "tag": "27fc5873-ec35-4bac-84c6-d94cd83ef196"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:39.921208 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-4403a7d1-480c-430b-9405-128326f30dda req-7576d882-34f1-4748-b356-850affb2d38b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:39.921713 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-4403a7d1-480c-430b-9405-128326f30dda req-7576d882-34f1-4748-b356-850affb2d38b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:39.935119 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-4403a7d1-480c-430b-9405-128326f30dda req-7576d882-34f1-4748-b356-850affb2d38b service nova] Creating event network-vif-deleted:27fc5873-ec35-4bac-84c6-d94cd83ef196 for instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 on hv-cinder-84456 Aug 03 10:06:39.942043 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-4403a7d1-480c-430b-9405-128326f30dda req-7576d882-34f1-4748-b356-850affb2d38b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035871 Aug 03 10:06:39.942761 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:39.943234 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1676/3231] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:39.943578 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:39.954104 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:39.954554 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:39.955348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:39.955794 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:40.031786 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:40.039844 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4ff7fa50-7135-4702-9b93-75ae247309c8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 200 len: 1299 microversion: 2.1 time: 0.101810 Aug 03 10:06:40.040402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1556/3232] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:39 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:06:41.061280 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:41.062045 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 9a8ffb87-f394-456e-a436-d89b2eb6eb98] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:41.068761 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:41.069447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:41.070325 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:41.070805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:41.084885 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.wsgi [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] HTTP exception thrown: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Request method failure captured: Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: request: GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 HTTP/1.1 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept: application/json Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Accept-Encoding: identity Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Connection: close Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Length: 0 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Content-Type: application/json Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Host: 10.222.0.20 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Openstack-System-Scope: None Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: User-Agent: python-urllib3/1.26.10 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Auth-Token: gAAAAABi6kiXpgWh9UPcJ4OHF5ZosgT3oxiAilcek_FUSfKQ27kEaND1igxSsOfvyMNdEP-NmZ_XhTUcJFUBCU7oUFYzT4Q1Bk2XeqnHc46_JTRJsdnR_ev8_8x3Xun_yFdLGzzKnjUFyY0pyDNZR3aCFOpIpHqVSQyZ134EglzhGHEmsRK1440 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Id: None Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Domain-Name: None Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Identity-Status: Confirmed Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Is-Admin-Project: True Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Id: default Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Domain-Name: Default Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Id: 45e76f564d954f18aff24f9d1066f3de Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Project-Name: tempest-VolumesActionsTest-364442489 Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Role: member,reader Aug 03 10:06:41.086544 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Roles: member,reader Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45e76f564d954f18aff24f9d1066f3de"}]}] Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant: tempest-VolumesActionsTest-364442489 Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Id: 45e76f564d954f18aff24f9d1066f3de Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-Tenant-Name: tempest-VolumesActionsTest-364442489 Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User: tempest-VolumesActionsTest-364442489-project Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Id: default Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Domain-Name: Default Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Id: 60483d6df5444b3abf3ff3402d7335e8 Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: X-User-Name: tempest-VolumesActionsTest-364442489-project Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: method: > Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: exception: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. Aug 03 10:06:41.088528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: action_args: {'id': '9a8ffb87-f394-456e-a436-d89b2eb6eb98'} Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:06:41.089719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. Aug 03 10:06:41.091530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: ERROR nova.api.openstack.wsgi Aug 03 10:06:41.093268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Returning 404 to user: Instance 9a8ffb87-f394-456e-a436-d89b2eb6eb98 could not be found. {{(pid=117929) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:06:41.093268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7fbb6283-1ee4-4ad9-bb59-2dbc8b09e85b tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98" status: 404 len: 111 microversion: 2.1 time: 0.031108 Aug 03 10:06:41.093268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1677/3233] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:41 2022] GET /compute/v2.1/servers/9a8ffb87-f394-456e-a436-d89b2eb6eb98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:06:41.190801 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2011910226", "imageRef": "cc8512d1-be04-4cf9-90f6-52470ebb456b", "flavorRef": "452", "networks": [{"uuid": "b7847bd7-ff0b-4acd-b98d-aaee1df1c755"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:41.253974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] validate_networks() for [('b7847bd7-ff0b-4acd-b98d-aaee1df1c755', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:06:41.718705 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:06:41.719128 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:06:41.719617 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:06:41.720081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:06:41.720507 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:06:41.731255 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:41.731710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:41.732560 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:41.733030 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:41.752042 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Getting quotas for project 45e76f564d954f18aff24f9d1066f3de. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:06:41.764166 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Getting quotas for user 60483d6df5444b3abf3ff3402d7335e8 and project 45e76f564d954f18aff24f9d1066f3de. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:06:41.777615 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:06:41.779907 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc8512d1-be04-4cf9-90f6-52470ebb456b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:06:41.832277 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-7bead4ca-c438-4d32-8b71-c3b5ccf6087e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645940 Aug 03 10:06:41.832768 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1557/3234] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 10:06:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:06:41.845352 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-62dbdc7f-c2d6-4308-95a8-ae46b2ae3b6d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:41.845975 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-62dbdc7f-c2d6-4308-95a8-ae46b2ae3b6d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:41.919522 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-62dbdc7f-c2d6-4308-95a8-ae46b2ae3b6d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:41.926898 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-62dbdc7f-c2d6-4308-95a8-ae46b2ae3b6d tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1214 microversion: 2.1 time: 0.085537 Aug 03 10:06:41.928300 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1678/3235] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:41 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:06:42.959566 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:42.960438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:42.974623 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:42.979208 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:42.981329 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:42.983493 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:43.093475 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:43.104362 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-73fa1bdc-1322-4c90-b7f3-8124b839f731 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1284 microversion: 2.1 time: 0.158223 Aug 03 10:06:43.118050 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1558/3236] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:42 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:44.127854 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:44.128829 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:44.144256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:44.144256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:44.144256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:44.144256 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:44.150258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:44.374048 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:44.384003 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd1aef64-2df9-4971-87cf-8ebe29bbcf79 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.262361 Aug 03 10:06:44.384742 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1679/3237] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:44 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:44.624071 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-dec53e3e-3335-4747-88b0-ba49d8b59272 req-6bb63982-8a19-4392-b557-7786de2b466e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72bb8eab-384e-40c4-ad2d-3cc23cb01b4f", "tag": "2ff2ee95-cc9c-464f-844a-6fc6aa4a05de"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:44.631126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:44.637430 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dec53e3e-3335-4747-88b0-ba49d8b59272 req-6bb63982-8a19-4392-b557-7786de2b466e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:44.638203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-dec53e3e-3335-4747-88b0-ba49d8b59272 req-6bb63982-8a19-4392-b557-7786de2b466e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:44.657490 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-dec53e3e-3335-4747-88b0-ba49d8b59272 req-6bb63982-8a19-4392-b557-7786de2b466e service nova] Creating event network-changed:2ff2ee95-cc9c-464f-844a-6fc6aa4a05de for instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f on hv-cinder-84456 Aug 03 10:06:44.664105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-dec53e3e-3335-4747-88b0-ba49d8b59272 req-6bb63982-8a19-4392-b557-7786de2b466e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046262 Aug 03 10:06:44.665062 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1559/3238] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:45.406847 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:45.407450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:45.409721 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:45.415624 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:45.416068 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:45.416831 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:45.417264 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:45.555474 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:45.563369 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b20f0f75-3c38-42ec-b81d-3ebe00fe5eb5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.160293 Aug 03 10:06:45.563932 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1680/3239] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:45 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:46.584691 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:46.585406 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:46.592467 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:46.592874 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:46.593625 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:46.594059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:46.748740 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:46.756985 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-df321e90-ab03-4596-bc22-56537f1d37f3 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.176322 Aug 03 10:06:46.757545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1560/3240] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:46 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:47.777355 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:47.777972 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:47.784546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:47.785041 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:47.785797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:47.786233 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:47.918764 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:47.926426 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-50b5e3ad-e68e-49e3-b4a2-6c1a98813330 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.153654 Aug 03 10:06:47.927126 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1681/3241] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:47 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:48.947045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:48.947820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:48.954970 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:48.955409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:48.956189 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:48.956616 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:49.088830 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:49.096173 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-ea8337b3-257c-4d10-adcc-ab93d73fea6e tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.153129 Aug 03 10:06:49.096719 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1561/3242] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:48 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:50.119435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:50.120052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:50.126576 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:50.127022 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:50.127770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:50.128197 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:50.255917 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:50.264057 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dcb43a2b-9421-43c4-974a-ef932f12acab tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.149057 Aug 03 10:06:50.264626 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1682/3243] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:50 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:51.284918 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:51.285526 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:51.292284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:51.292755 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:51.293569 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:51.293993 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:51.423640 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:51.432018 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-06b6ef48-9748-4d85-bdbb-13cd0171f6a8 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.150810 Aug 03 10:06:51.432586 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1562/3244] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:51 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:52.446642 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-e7755eca-d3f4-46ab-9bca-8cfbc1d996d8 req-9465e547-1106-4b2d-8548-5832e924d646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bb8eab-384e-40c4-ad2d-3cc23cb01b4f", "name": "network-vif-plugged", "status": "completed", "tag": "2ff2ee95-cc9c-464f-844a-6fc6aa4a05de"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:06:52.452345 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=2 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:52.453743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:52.454826 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:52.458635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-e7755eca-d3f4-46ab-9bca-8cfbc1d996d8 req-9465e547-1106-4b2d-8548-5832e924d646 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:52.459078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-e7755eca-d3f4-46ab-9bca-8cfbc1d996d8 req-9465e547-1106-4b2d-8548-5832e924d646 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:52.460582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:52.461291 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:06:52.464545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:52.464899 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:52.465669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:52.466412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:52.473066 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-e7755eca-d3f4-46ab-9bca-8cfbc1d996d8 req-9465e547-1106-4b2d-8548-5832e924d646 service nova] Creating event network-vif-plugged:2ff2ee95-cc9c-464f-844a-6fc6aa4a05de for instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f on hv-cinder-84456 Aug 03 10:06:52.478468 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-e7755eca-d3f4-46ab-9bca-8cfbc1d996d8 req-9465e547-1106-4b2d-8548-5832e924d646 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036095 Aug 03 10:06:52.479350 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1683/3245] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:06:52.613952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:52.622180 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-57100eb1-4f28-4f8a-bf2a-c7b419907ca7 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.172815 Aug 03 10:06:52.622747 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1563/3246] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:52 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:53.644428 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:53.645179 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:53.651450 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:53.651900 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:53.652662 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:53.653139 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:53.792647 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:53.800454 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-7e8145d6-94d7-42ac-899c-2cd4168567e0 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1314 microversion: 2.1 time: 0.160717 Aug 03 10:06:53.801052 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1684/3247] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:53 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:54.822631 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:54.823314 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:54.830814 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:54.831254 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:54.832034 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:54.832483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:54.976438 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:54.985587 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d694486c-28d8-4675-a859-901816d088b5 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1498 microversion: 2.1 time: 0.167310 Aug 03 10:06:54.986634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1564/3248] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:54 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:57.637560 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:57.638411 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:57.644701 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:57.645186 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:57.645950 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:57.646370 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:57.678822 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:06:57.755108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1c966ce8-07ec-4743-9e2f-8bb00cf56d20 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "DELETE /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 204 len: 0 microversion: 2.1 time: 0.122137 Aug 03 10:06:57.755953 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1685/3249] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:06:57 2022] DELETE /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:06:57.764045 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:57.764725 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:57.771145 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:57.771582 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:57.772338 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:57.772749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:57.900333 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:57.907789 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-857efb39-1038-450c-845d-652da0947b13 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1504 microversion: 2.1 time: 0.147633 Aug 03 10:06:57.908355 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1565/3250] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:57 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:06:58.930684 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:06:58.931393 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:06:58.937842 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:58.938314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:58.939069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:06:58.939505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:06:59.073800 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:06:59.081789 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dbc30122-0195-447e-8093-5afebe302d80 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1504 microversion: 2.1 time: 0.155686 Aug 03 10:06:59.082195 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1686/3251] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:06:58 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:00.104231 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:00.104902 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:00.118348 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:00.118933 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:00.119852 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:00.120701 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:00.189558 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-d70a9b71-cee3-4425-b8f0-6110c32c1bc1 req-e977efe6-fd7c-43fa-99f7-f2153b2ea33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72bb8eab-384e-40c4-ad2d-3cc23cb01b4f", "name": "network-vif-deleted", "tag": "2ff2ee95-cc9c-464f-844a-6fc6aa4a05de"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:07:00.203794 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d70a9b71-cee3-4425-b8f0-6110c32c1bc1 req-e977efe6-fd7c-43fa-99f7-f2153b2ea33e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:00.203944 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60483d6df5444b3abf3ff3402d7335e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45e76f564d954f18aff24f9d1066f3de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:00.204238 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-d70a9b71-cee3-4425-b8f0-6110c32c1bc1 req-e977efe6-fd7c-43fa-99f7-f2153b2ea33e service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:00.213669 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-48895926-0bc2-43ea-9bf4-3b9b244db2a2 tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 200 len: 1462 microversion: 2.1 time: 0.113107 Aug 03 10:07:00.214266 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1566/3252] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:00 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 1462 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:00.231245 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-d70a9b71-cee3-4425-b8f0-6110c32c1bc1 req-e977efe6-fd7c-43fa-99f7-f2153b2ea33e service nova] Creating event network-vif-deleted:2ff2ee95-cc9c-464f-844a-6fc6aa4a05de for instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f on hv-cinder-84456 Aug 03 10:07:00.235941 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-d70a9b71-cee3-4425-b8f0-6110c32c1bc1 req-e977efe6-fd7c-43fa-99f7-f2153b2ea33e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050540 Aug 03 10:07:00.236546 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1687/3253] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:07:01.235837 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:01.236230 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] [instance: 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:01.242553 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:01.243024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:01.244337 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:01.244765 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:01.258370 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] HTTP exception thrown: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Request method failure captured: Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f HTTP/1.1 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kiXpgWh9UPcJ4OHF5ZosgT3oxiAilcek_FUSfKQ27kEaND1igxSsOfvyMNdEP-NmZ_XhTUcJFUBCU7oUFYzT4Q1Bk2XeqnHc46_JTRJsdnR_ev8_8x3Xun_yFdLGzzKnjUFyY0pyDNZR3aCFOpIpHqVSQyZ134EglzhGHEmsRK1440 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 45e76f564d954f18aff24f9d1066f3de Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-VolumesActionsTest-364442489 Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:07:01.260163 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_45e76f564d954f18aff24f9d1066f3de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/45e76f564d954f18aff24f9d1066f3de"}]}] Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-VolumesActionsTest-364442489 Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 45e76f564d954f18aff24f9d1066f3de Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-VolumesActionsTest-364442489 Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-VolumesActionsTest-364442489-project Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 60483d6df5444b3abf3ff3402d7335e8 Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-VolumesActionsTest-364442489-project Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. Aug 03 10:07:01.261800 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '72bb8eab-384e-40c4-ad2d-3cc23cb01b4f'} Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:07:01.262714 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. Aug 03 10:07:01.264332 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:07:01.265712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] Returning 404 to user: Instance 72bb8eab-384e-40c4-ad2d-3cc23cb01b4f could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:07:01.265712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-442c6e5d-4865-446c-a71a-f5a338b62adb tempest-VolumesActionsTest-364442489 tempest-VolumesActionsTest-364442489-project] 10.222.0.20 "GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f" status: 404 len: 111 microversion: 2.1 time: 0.030024 Aug 03 10:07:01.265712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1567/3254] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:01 2022] GET /compute/v2.1/servers/72bb8eab-384e-40c4-ad2d-3cc23cb01b4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:07:15.091704 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:07:15.092363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:07:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:07:41.895517 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:41.896259 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:41.900467 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-e851da8e-a2da-4fb5-8113-194d0e5111be tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'create', calling method: .version_select at 0x7fb998d20790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-160260521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfS/+eNUKYCTeoqcX7MWJGcdqqojqhvP9jmcyiDjHbUi3elVkgUgt281p30vRgL5vCOKKpChuouvA98qYjo2C2f1mMV6koGg8MlhIsfPsfXtD04u3PLY6Zp/rI/hjZ6cw=="}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:07:41.918447 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-e851da8e-a2da-4fb5-8113-194d0e5111be tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Getting quotas for project 66349dc44a7244ecac38ec4cf963b771. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:07:41.922111 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.quota [None req-e851da8e-a2da-4fb5-8113-194d0e5111be tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Getting quotas for user 321584c73f9e4f8aa05a8435df378715 and project 66349dc44a7244ecac38ec4cf963b771. Resources: {'key_pairs'} {{(pid=117929) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:07:41.946984 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-e851da8e-a2da-4fb5-8113-194d0e5111be tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052349 Aug 03 10:07:41.947916 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1688/3255] 10.222.0.20 () {60 vars in 1159 bytes} [Wed Aug 3 10:07:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:07:42.048481 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-324890584", "imageRef": "c6288400-857e-4270-a932-c2e3bde6ac89", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-160260521", "networks": [{"uuid": "2339ab93-c8b3-4dd6-bcdf-5be306c5104c"}]}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:07:42.057579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=17 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:42.058437 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=66 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:42.103100 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.network.neutron [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] validate_networks() for [('2339ab93-c8b3-4dd6-bcdf-5be306c5104c', None, None, None, None, None)] {{(pid=117928) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 03 10:07:42.470987 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Flavor limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 03 10:07:42.471402 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Image limits 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 03 10:07:42.471864 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Flavor pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 03 10:07:42.472264 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Image pref 0:0:0 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 03 10:07:42.472664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.virt.hardware [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117928) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 03 10:07:42.482322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:42.482763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:42.483543 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:42.483967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:42.501244 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Getting quotas for project 66349dc44a7244ecac38ec4cf963b771. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 03 10:07:42.505156 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.quota [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Getting quotas for user 321584c73f9e4f8aa05a8435df378715 and project 66349dc44a7244ecac38ec4cf963b771. Resources: {'ram', 'instances', 'cores'} {{(pid=117928) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 03 10:07:42.516076 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Going to run 1 instances... {{(pid=117928) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 03 10:07:42.518256 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c6288400-857e-4270-a932-c2e3bde6ac89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117928) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 03 10:07:42.563940 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-3eb35ab5-eccb-474f-99dd-78c6e8808a08 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519491 Aug 03 10:07:42.564561 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1568/3256] 10.222.0.20 () {60 vars in 1147 bytes} [Wed Aug 3 10:07:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 03 10:07:42.575464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-1e21d83d-65f8-491b-95d7-f9a81abb04d4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:42.576190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-1e21d83d-65f8-491b-95d7-f9a81abb04d4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:42.634880 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-1e21d83d-65f8-491b-95d7-f9a81abb04d4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:42.642107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-1e21d83d-65f8-491b-95d7-f9a81abb04d4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1257 microversion: 2.1 time: 0.070777 Aug 03 10:07:42.642666 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1689/3257] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:42 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:07:43.663644 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:43.664247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:43.671522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:43.671974 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:43.672751 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:43.673473 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:43.758260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:43.767170 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dc24ae37-be6e-40d9-ade3-b4f2e5cd84ee tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1315 microversion: 2.1 time: 0.107935 Aug 03 10:07:43.767921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1569/3258] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:43 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1315 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:44.790496 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:44.792039 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:44.802004 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:44.802456 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:44.803231 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:44.803667 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:44.951743 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:44.959770 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-8a00bae9-b6a4-4b6d-8ade-3a08331e7a9c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.174230 Aug 03 10:07:44.960444 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1690/3259] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:44 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:45.981763 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:45.982485 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:45.989155 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:45.989534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:45.990309 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:45.990743 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:46.141744 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:46.154532 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8b529ca0-9261-4fee-9460-fd220c7c80c7 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.177231 Aug 03 10:07:46.155111 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1570/3260] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:45 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:47.175635 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:47.176318 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:47.183954 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:47.184394 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:47.185190 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:47.185627 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:47.327130 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:47.335738 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-de624b3d-ac77-401e-96fb-08b366d056b8 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.163982 Aug 03 10:07:47.336691 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1691/3261] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:47 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:48.357171 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:48.358107 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:48.364403 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:48.364891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:48.365661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:48.366097 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:48.539335 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:48.548197 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a027f107-3697-43f1-9080-0f0b5c986e9f tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.195270 Aug 03 10:07:48.548838 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1571/3262] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:48 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:49.570141 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:49.570797 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:49.577890 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:49.578332 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:49.579077 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:49.579740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:49.729801 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:49.738567 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-fd18d69d-e46b-4f10-96f7-a7e24aa9f156 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.172829 Aug 03 10:07:49.749007 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1692/3263] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:49 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:50.760583 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:50.761281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:50.767711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:50.768148 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:50.769005 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:50.769429 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:50.927190 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:50.939408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-f8b878b1-29c2-4243-8cf7-bc84d7b42c7b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.178964 Aug 03 10:07:50.939408 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1572/3264] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:50 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:07:51.957665 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:51.958267 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:51.965108 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:51.965562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:51.966346 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:51.966777 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:52.097530 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:52.105649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-abc374e5-62e8-4916-b450-e4056511dc8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.151789 Aug 03 10:07:52.106201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1693/3265] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:51 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:53.113712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-807ef981-db48-4eac-982a-6c7130971be4 req-4d7be7c6-4103-4a9d-be86-bf4307833d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:07:53.126749 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:53.127986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:53.130169 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell0:SELECT=6 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:53.134409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:53.137521 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=6 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:07:53.140063 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-807ef981-db48-4eac-982a-6c7130971be4 req-4d7be7c6-4103-4a9d-be86-bf4307833d5c service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:53.140519 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-807ef981-db48-4eac-982a-6c7130971be4 req-4d7be7c6-4103-4a9d-be86-bf4307833d5c service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:53.151120 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:53.151565 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:53.152338 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:53.152771 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:53.161203 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-807ef981-db48-4eac-982a-6c7130971be4 req-4d7be7c6-4103-4a9d-be86-bf4307833d5c service nova] Creating event network-changed:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:07:53.167938 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-807ef981-db48-4eac-982a-6c7130971be4 req-4d7be7c6-4103-4a9d-be86-bf4307833d5c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057982 Aug 03 10:07:53.169261 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1573/3266] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:07:53.353154 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:53.360841 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-96250f1a-5d4a-438f-a519-8297ed7386f6 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.237754 Aug 03 10:07:53.361420 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1694/3267] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:53 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:07:54.383169 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:54.384524 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:54.390629 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:54.391083 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:54.391850 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:54.392283 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:54.522349 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:54.531081 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-adb83bec-f66a-4e38-be24-838e3e57289d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.152613 Aug 03 10:07:54.531643 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1574/3268] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:54 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:55.551160 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:55.551745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:55.559572 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:55.560014 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:55.560759 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:55.561223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:55.693204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:55.701506 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-dd6ca517-3f41-44b4-93cf-17c2e0cd4fa5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.154160 Aug 03 10:07:55.702071 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1695/3269] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:55 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:56.722135 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:56.722769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:56.729336 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:56.729772 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:56.730522 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:56.730946 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:56.772619 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-330532ea-cf10-4ee5-aefd-12058e2ac1d3 req-53fd1ff2-bf7e-46eb-891f-d3681c83ee47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "name": "network-vif-plugged", "status": "completed", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:07:56.784805 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-330532ea-cf10-4ee5-aefd-12058e2ac1d3 req-53fd1ff2-bf7e-46eb-891f-d3681c83ee47 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:56.785271 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-330532ea-cf10-4ee5-aefd-12058e2ac1d3 req-53fd1ff2-bf7e-46eb-891f-d3681c83ee47 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:56.797314 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-330532ea-cf10-4ee5-aefd-12058e2ac1d3 req-53fd1ff2-bf7e-46eb-891f-d3681c83ee47 service nova] Creating event network-vif-plugged:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:07:56.802289 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-330532ea-cf10-4ee5-aefd-12058e2ac1d3 req-53fd1ff2-bf7e-46eb-891f-d3681c83ee47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033703 Aug 03 10:07:56.802882 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1696/3270] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:07:56.891664 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:56.899214 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1dca3fed-b858-48ab-8615-d54a696dfa01 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.180908 Aug 03 10:07:56.899780 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1575/3271] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:56 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:57.921073 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:57.921804 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:57.927934 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:57.928374 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:57.929149 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:57.929578 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:58.065078 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:58.073518 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f67b6a15-8753-4d3b-9193-4baf729d8017 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1357 microversion: 2.1 time: 0.157135 Aug 03 10:07:58.074081 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1697/3272] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:57 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:07:59.097306 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:59.098460 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:59.105914 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.106354 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.107110 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.107534 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.260749 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:59.269157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-8fce849a-0995-4521-93dd-a58db07bcc95 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1546 microversion: 2.1 time: 0.177191 Aug 03 10:07:59.269731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1576/3273] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:59 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:07:59.290651 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:59.291301 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:59.299923 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.300681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.301992 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.302737 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.458110 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:59.467600 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-c4aedaa7-3608-45ff-8fc2-9d126b4e29d5 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1546 microversion: 2.1 time: 0.181377 Aug 03 10:07:59.468176 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1698/3274] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:59 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:07:59.488284 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:59.493849 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:59.494608 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Searching by: {'deleted': False, 'project_id': '66349dc44a7244ecac38ec4cf963b771'} {{(pid=117928) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 03 10:07:59.503758 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.504479 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.505858 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.506577 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.614085 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.multi_cell_list [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117928) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 03 10:07:59.718900 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-c8f0c613-2e82-4733-a63b-127960bc422c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.234406 Aug 03 10:07:59.719398 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1577/3275] 10.222.0.20 () {58 vars in 1125 bytes} [Wed Aug 3 10:07:59 2022] GET /compute/v2.1/servers => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:07:59.731342 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:07:59.731957 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:07:59.738204 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.738649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.739392 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:07:59.739816 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:07:59.866772 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:07:59.874336 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-d6a937e4-c3a3-4683-bd7c-fcbf2cd1bddc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1546 microversion: 2.1 time: 0.147401 Aug 03 10:07:59.874897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1699/3276] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:07:59 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1546 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:01.423767 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe4fa642-bc4a-4b39-a6f4-bdae93152ef9"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:08:01.426158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:01.433523 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:01.433971 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:01.434735 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:01.435168 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:01.832345 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6a4307c9-cfaf-4b3c-bd10-d0e272c10ebc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.412404 Aug 03 10:08:01.832977 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1578/3277] 10.222.0.20 () {60 vars in 1323 bytes} [Wed Aug 3 10:08:01 2022] POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments => generated 194 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:08:08.347605 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:08.348323 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:08.358258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:08.358710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:08.359482 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:08.359913 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:08.490155 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:08.498715 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-9e4549ca-c302-4610-8acd-e1d59d771a8a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1592 microversion: 2.1 time: 0.154997 Aug 03 10:08:08.499282 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1700/3278] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:08 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1592 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:10.376073 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell0:SELECT=2 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:10.380482 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-b1cea74b-6963-4c2a-97b7-e30edf5edfc6 req-1a3cadd6-99f3-4f1d-87a2-2e744149db0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:08:10.391731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b1cea74b-6963-4c2a-97b7-e30edf5edfc6 req-1a3cadd6-99f3-4f1d-87a2-2e744149db0b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:10.392164 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-b1cea74b-6963-4c2a-97b7-e30edf5edfc6 req-1a3cadd6-99f3-4f1d-87a2-2e744149db0b service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:10.404653 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-b1cea74b-6963-4c2a-97b7-e30edf5edfc6 req-1a3cadd6-99f3-4f1d-87a2-2e744149db0b service nova] Creating event network-changed:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:08:10.409990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-b1cea74b-6963-4c2a-97b7-e30edf5edfc6 req-1a3cadd6-99f3-4f1d-87a2-2e744149db0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035228 Aug 03 10:08:10.411026 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1579/3279] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:08:11.511712 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-291285935"}} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:08:11.512244 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:11.518773 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:11.519223 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:11.519978 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:11.520416 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:11.651645 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.network.security_group_api [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Adding security group ce0b2753-c8f4-4697-8c3f-7ad63368d524 to port b07452a4-3604-4097-83d7-c128e047d409 Aug 03 10:08:11.965710 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-07a3e302-a633-43a3-abb6-7c3d27ba9277 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action" status: 202 len: 0 microversion: 2.1 time: 0.458586 Aug 03 10:08:11.966382 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1701/3280] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 10:08:11 2022] POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:08:11.975792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:11.976712 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:11.984679 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:11.985836 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:11.986710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:11.987154 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:12.409954 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:12.412373 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:12.420280 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-dbdaf81f-71da-44da-bc1b-bbf023064cce tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1756 microversion: 2.1 time: 0.449239 Aug 03 10:08:12.420883 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1580/3281] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:11 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1756 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:12.440214 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-6bb05326-69fb-4c06-bcad-321d747311fc req-0aba53ba-64be-4da4-884e-420855c0fef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:08:12.445142 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:12.451763 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6bb05326-69fb-4c06-bcad-321d747311fc req-0aba53ba-64be-4da4-884e-420855c0fef0 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:12.452205 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-6bb05326-69fb-4c06-bcad-321d747311fc req-0aba53ba-64be-4da4-884e-420855c0fef0 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:12.456505 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=67 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:12.466069 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-6bb05326-69fb-4c06-bcad-321d747311fc req-0aba53ba-64be-4da4-884e-420855c0fef0 service nova] Creating event network-changed:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:08:12.471019 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-6bb05326-69fb-4c06-bcad-321d747311fc req-0aba53ba-64be-4da4-884e-420855c0fef0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049637 Aug 03 10:08:12.471620 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1702/3282] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:08:29.428542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:08:29.430721 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:29.433792 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:29.441046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:29.441609 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:29.442365 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:29.442795 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:29.514368 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-d5851c65-9531-4393-be6f-02916198f7f4 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action" status: 202 len: 0 microversion: 2.1 time: 0.089855 Aug 03 10:08:29.514986 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1581/3283] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 10:08:29 2022] POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:08:29.521133 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:29.521938 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=1 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:08:29.526762 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:29.527330 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:29.535144 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:29.535707 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:29.536488 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:29.536993 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:29.771563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:29.780215 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3fe3857d-1d9c-495f-8eb1-99a404b7cfec tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1748 microversion: 2.1 time: 0.260625 Aug 03 10:08:29.780778 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1703/3284] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:29 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1748 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:30.802952 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:30.803634 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:30.811059 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:30.811496 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:30.812245 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:30.812673 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:30.956991 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:30.964990 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b6420c9c-8272-499b-ab1b-af91d1444086 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.166646 Aug 03 10:08:30.965544 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1582/3285] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:30 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:31.985858 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:31.986464 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:31.992979 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:31.993422 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:31.994194 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:31.995127 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:32.137719 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:32.145500 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-adb5de22-8873-4098-a17e-d8bfc4a32501 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.163451 Aug 03 10:08:32.146054 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1704/3286] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:31 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:33.166225 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:33.167200 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:33.173024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:33.173472 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:33.174227 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:33.174661 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:33.315158 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:33.323936 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-74469fd8-bb2a-4af4-9762-5164bbfc63c1 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.161751 Aug 03 10:08:33.324498 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1583/3287] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:33 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:34.345503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:34.346097 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:34.352528 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:34.353018 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:34.353781 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:34.354807 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:34.494384 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:34.502240 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-323af40a-e198-4d2b-a448-d8bfa0a467cc tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.160683 Aug 03 10:08:34.502808 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1705/3288] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:34 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:35.523322 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:35.523934 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:35.530760 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:35.531209 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:35.531967 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:35.532405 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:35.674044 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:35.681862 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-77e261a6-7b21-4ae5-b819-32a84db45797 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.162436 Aug 03 10:08:35.683126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1584/3289] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:35 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:36.703928 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:36.704537 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:36.711114 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:36.711562 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:36.712317 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:36.712751 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:36.857965 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:36.865897 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b0c757e7-dd20-4c54-8f6a-03e0c9478f9b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.165878 Aug 03 10:08:36.866449 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1706/3290] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:36 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 03 10:08:37.888296 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:37.888915 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:37.895300 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:37.895742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:37.896486 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:37.896937 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:38.042418 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:38.050328 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-4e2d66e0-9b8d-4cb1-a427-906632e12fa0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.166633 Aug 03 10:08:38.050890 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1585/3291] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:37 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:39.071555 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:39.072201 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:39.079435 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:39.079883 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:39.080638 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:39.081107 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:39.223047 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:39.231377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-b6a7c01f-4f3d-446e-8eac-bd56d9595498 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.163746 Aug 03 10:08:39.231930 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1707/3292] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:39 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:40.252204 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:40.252803 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:40.259383 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:40.259820 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:40.260646 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:40.261099 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:40.402444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:40.410307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-1809218a-ecda-4f11-b129-4853ba1f9357 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1753 microversion: 2.1 time: 0.161976 Aug 03 10:08:40.410863 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1586/3293] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:40 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:41.431161 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:08:41.431769 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:08:41.439115 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:41.439563 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:41.440320 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:08:41.440755 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:08:41.588278 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:08:41.597673 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-01af3d6f-c283-42a8-bc6f-75e234ea9418 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1756 microversion: 2.1 time: 0.170425 Aug 03 10:08:41.598248 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1708/3294] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:08:41 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:08:47.341253 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:08:47.341733 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:09:00.621711 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:09:00.622475 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:09:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:09:14.123878 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-291285935"}} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:09:14.124435 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:14.126565 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_api:SELECT=12 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:09:14.127346 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG dbcounter [-] [117928] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117928) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:09:14.134001 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:14.134444 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:14.135753 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:14.136178 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:14.266281 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.network.security_group_api [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Removing security group ce0b2753-c8f4-4697-8c3f-7ad63368d524 from port b07452a4-3604-4097-83d7-c128e047d409 Aug 03 10:09:14.577191 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6d891230-bb07-4fea-a198-3f002231475d tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action" status: 202 len: 0 microversion: 2.1 time: 0.457847 Aug 03 10:09:14.578192 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1587/3295] 10.222.0.20 () {60 vars in 1278 bytes} [Wed Aug 3 10:09:14 2022] POST /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:09:14.589535 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_api:SELECT=12 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:09:14.591843 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG dbcounter [-] [117929] Writing DB stats nova_cell1:SELECT=36 {{(pid=117929) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 03 10:09:14.737529 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [req-a05ae69c-6b96-4123-bffe-b70df5316e5b req-f83b7960-09da-4d5f-b88d-dee0d04b6433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:09:14.748575 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a05ae69c-6b96-4123-bffe-b70df5316e5b req-f83b7960-09da-4d5f-b88d-dee0d04b6433 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:14.749340 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [req-a05ae69c-6b96-4123-bffe-b70df5316e5b req-f83b7960-09da-4d5f-b88d-dee0d04b6433 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:14.763029 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.compute.server_external_events [req-a05ae69c-6b96-4123-bffe-b70df5316e5b req-f83b7960-09da-4d5f-b88d-dee0d04b6433 service nova] Creating event network-changed:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:09:14.768745 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [req-a05ae69c-6b96-4123-bffe-b70df5316e5b req-f83b7960-09da-4d5f-b88d-dee0d04b6433 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184795 Aug 03 10:09:14.770145 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1709/3296] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 03 10:09:15.623943 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:15.624452 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:15.630454 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:15.630903 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:15.631675 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:15.632130 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:15.714764 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.objects.instance [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lazy-loading 'services' on Instance uuid 2119967d-1fc3-456b-81e6-ca88013a663e {{(pid=117928) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:09:15.801891 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-b05dfa42-590d-4e43-a04c-36b981953685 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments/fe4fa642-bc4a-4b39-a6f4-bdae93152ef9" status: 202 len: 0 microversion: 2.1 time: 0.182898 Aug 03 10:09:15.802711 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1588/3297] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 10:09:15 2022] DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments/fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 03 10:09:15.814919 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:15.817503 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:15.826844 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:15.827277 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:15.828037 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:15.828466 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:15.862741 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f2f2a209-301c-409b-b4d1-d2d649193d46 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054117 Aug 03 10:09:15.863768 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1710/3298] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 10:09:15 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:09:16.789024 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-1979a3df-6823-48ce-a195-87873b3b31bf req-4d8ff09e-7041-4da4-a9eb-4898ff243397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:09:16.798722 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1979a3df-6823-48ce-a195-87873b3b31bf req-4d8ff09e-7041-4da4-a9eb-4898ff243397 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:16.799157 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-1979a3df-6823-48ce-a195-87873b3b31bf req-4d8ff09e-7041-4da4-a9eb-4898ff243397 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:16.810008 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-1979a3df-6823-48ce-a195-87873b3b31bf req-4d8ff09e-7041-4da4-a9eb-4898ff243397 service nova] Creating event network-changed:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:09:16.814773 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-1979a3df-6823-48ce-a195-87873b3b31bf req-4d8ff09e-7041-4da4-a9eb-4898ff243397 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030287 Aug 03 10:09:16.815410 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1589/3299] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:09:16.875640 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:16.877998 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:16.885324 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:16.886038 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:16.886723 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:16.887162 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:16.917486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-67683708-3c08-4e8d-886a-64960c74eadd tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045801 Aug 03 10:09:16.918258 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1711/3300] 10.222.0.20 () {58 vars in 1302 bytes} [Wed Aug 3 10:09:16 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 03 10:09:16.929009 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:16.929654 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:16.936080 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:16.936592 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:16.937434 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:16.937925 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:17.014427 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] HTTP exception thrown: Instance 2119967d-1fc3-456b-81e6-ca88013a663e is not attached to volume fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Request method failure captured: Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments/fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 HTTP/1.1 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kjfnzzDi--aAlSsuwAs4cIyP1G41s2XX1iJ91zpc60r9vdzAGpSIv3-vAm5R_LIue92xR0hNQlJRS9LLhLMqgEdUBySpQx-HlbA3ryl4fMV-54pXXjarPaPxx8q10f1xEV9qtUJlhykosqMNjymjGGwgf3ORt--78xrNnDhF9k4KaY Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 66349dc44a7244ecac38ec4cf963b771 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:09:17.019636 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66349dc44a7244ecac38ec4cf963b771"}]}] Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 66349dc44a7244ecac38ec4cf963b771 Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-TestMinimumBasicScenario-542093094-project Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 321584c73f9e4f8aa05a8435df378715 Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestMinimumBasicScenario-542093094-project Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:09:17.021105 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 2119967d-1fc3-456b-81e6-ca88013a663e is not attached to volume fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'server_id': '2119967d-1fc3-456b-81e6-ca88013a663e', 'id': 'fe4fa642-bc4a-4b39-a6f4-bdae93152ef9'} Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fe4fa642-bc4a-4b39-a6f4-bdae93152ef9. Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:09:17.021835 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2119967d-1fc3-456b-81e6-ca88013a663e is not attached to volume fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2119967d-1fc3-456b-81e6-ca88013a663e is not attached to volume fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:17.022809 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Returning 404 to user: Instance 2119967d-1fc3-456b-81e6-ca88013a663e is not attached to volume fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:09:17.023630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-a07e483b-330b-4ba2-bc02-7d91b8efa37c tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments/fe4fa642-bc4a-4b39-a6f4-bdae93152ef9" status: 404 len: 154 microversion: 2.1 time: 0.096471 Aug 03 10:09:17.023630 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1590/3301] 10.222.0.20 () {58 vars in 1416 bytes} [Wed Aug 3 10:09:16 2022] DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e/os-volume_attachments/fe4fa642-bc4a-4b39-a6f4-bdae93152ef9 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:09:18.168486 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:18.169008 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:18.175377 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:18.175819 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:18.176573 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:18.177036 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:18.202740 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Going to try to terminate instance {{(pid=117929) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 03 10:09:18.278302 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-5e26ffb8-0f70-469f-b95e-8f9e3b69833b tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 204 len: 0 microversion: 2.1 time: 0.112854 Aug 03 10:09:18.278908 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1712/3302] 10.222.0.20 () {58 vars in 1239 bytes} [Wed Aug 3 10:09:18 2022] DELETE /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 03 10:09:18.287126 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:18.287731 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:18.294622 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:18.295074 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:18.295829 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:18.296260 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:18.424542 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.policy [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117928) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:09:18.432941 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-6ccaa810-0c6e-4100-b133-8f375297b4f0 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1552 microversion: 2.1 time: 0.149384 Aug 03 10:09:18.433499 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1591/3303] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:09:18 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:09:19.455281 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:19.455986 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:19.462492 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:19.462943 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:19.463782 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:19.464218 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:19.596310 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:09:19.604363 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-3666b454-4bbe-400d-925a-d098b4f856e3 tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1552 microversion: 2.1 time: 0.153346 Aug 03 10:09:19.604952 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1713/3304] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:09:19 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:09:20.474483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [req-2af98b66-0a95-407f-862e-7ed5278abdd3 req-560cbb8c-bead-4718-a998-e6eb50cb3567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2119967d-1fc3-456b-81e6-ca88013a663e", "name": "network-vif-deleted", "tag": "b07452a4-3604-4097-83d7-c128e047d409"}]} {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 03 10:09:20.484095 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-2af98b66-0a95-407f-862e-7ed5278abdd3 req-560cbb8c-bead-4718-a998-e6eb50cb3567 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:20.484545 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [req-2af98b66-0a95-407f-862e-7ed5278abdd3 req-560cbb8c-bead-4718-a998-e6eb50cb3567 service nova] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:20.495742 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.compute.server_external_events [req-2af98b66-0a95-407f-862e-7ed5278abdd3 req-560cbb8c-bead-4718-a998-e6eb50cb3567 service nova] Creating event network-vif-deleted:b07452a4-3604-4097-83d7-c128e047d409 for instance 2119967d-1fc3-456b-81e6-ca88013a663e on hv-cinder-84456 Aug 03 10:09:20.500307 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [req-2af98b66-0a95-407f-862e-7ed5278abdd3 req-560cbb8c-bead-4718-a998-e6eb50cb3567 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094390 Aug 03 10:09:20.500921 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1592/3305] 10.222.0.20 () {64 vars in 1317 bytes} [Wed Aug 3 10:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 03 10:09:20.625356 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:20.625889 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.compute.api [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117929) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:20.632274 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:20.632714 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:20.633499 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:20.633929 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:20.663798 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:20.664239 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG oslo_concurrency.lockutils [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117929) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:20.664681 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.objects.instance [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lazy-loading 'fault' on Instance uuid 2119967d-1fc3-456b-81e6-ca88013a663e {{(pid=117929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 03 10:09:20.709683 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.policy [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '321584c73f9e4f8aa05a8435df378715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66349dc44a7244ecac38ec4cf963b771', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117929) authorize /opt/stack/nova/nova/policy.py:199}} Aug 03 10:09:20.718329 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-f7a73fcd-9414-4113-aed4-83421a060ddb tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 200 len: 1347 microversion: 2.1 time: 0.096848 Aug 03 10:09:20.718912 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1714/3306] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:09:20 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 1347 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 03 10:09:21.740563 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '>' {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:21.741303 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.compute.api [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] [instance: 2119967d-1fc3-456b-81e6-ca88013a663e] Fetching instance by UUID {{(pid=117928) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 03 10:09:21.747645 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:21.748090 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:21.748917 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 03 10:09:21.749356 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG oslo_concurrency.lockutils [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Lock "0dd4996a-81ed-45f2-a688-0b41f856dafc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117928) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 03 10:09:21.763769 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.wsgi [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] HTTP exception thrown: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Request method failure captured: Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: request: GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e HTTP/1.1 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept: application/json Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Accept-Encoding: identity Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Connection: close Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Length: 0 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Content-Type: application/json Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Host: 10.222.0.20 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Openstack-System-Scope: None Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: User-Agent: python-urllib3/1.26.10 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Auth-Token: gAAAAABi6kjfnzzDi--aAlSsuwAs4cIyP1G41s2XX1iJ91zpc60r9vdzAGpSIv3-vAm5R_LIue92xR0hNQlJRS9LLhLMqgEdUBySpQx-HlbA3ryl4fMV-54pXXjarPaPxx8q10f1xEV9qtUJlhykosqMNjymjGGwgf3ORt--78xrNnDhF9k4KaY Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Id: None Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Domain-Name: None Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Identity-Status: Confirmed Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Is-Admin-Project: True Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Id: default Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Domain-Name: Default Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Id: 66349dc44a7244ecac38ec4cf963b771 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Project-Name: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Role: member,reader Aug 03 10:09:21.765412 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Roles: member,reader Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_66349dc44a7244ecac38ec4cf963b771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/66349dc44a7244ecac38ec4cf963b771"}]}] Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Id: 66349dc44a7244ecac38ec4cf963b771 Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-Tenant-Name: tempest-TestMinimumBasicScenario-542093094 Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User: tempest-TestMinimumBasicScenario-542093094-project Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Id: default Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Domain-Name: Default Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Id: 321584c73f9e4f8aa05a8435df378715 Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: X-User-Name: tempest-TestMinimumBasicScenario-542093094-project Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: method: > Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: exception: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. Aug 03 10:09:21.766710 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: action_args: {'id': '2119967d-1fc3-456b-81e6-ca88013a663e'} Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: {{(pid=117928) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 03 10:09:21.767445 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. Aug 03 10:09:21.768409 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: ERROR nova.api.openstack.wsgi Aug 03 10:09:21.769396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: DEBUG nova.api.openstack.wsgi [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Returning 404 to user: Instance 2119967d-1fc3-456b-81e6-ca88013a663e could not be found. {{(pid=117928) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 03 10:09:21.769396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO nova.api.openstack.requestlog [None req-868fbe90-1b66-4359-950d-19e3d85700da tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e" status: 404 len: 111 microversion: 2.1 time: 0.030982 Aug 03 10:09:21.769396 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: [pid: 117928|app: 0|req: 1593/3307] 10.222.0.20 () {58 vars in 1236 bytes} [Wed Aug 3 10:09:21 2022] GET /compute/v2.1/servers/2119967d-1fc3-456b-81e6-ca88013a663e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 03 10:09:21.776424 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: DEBUG nova.api.openstack.wsgi [None req-69ae93e3-3e1f-4bdc-bc3b-122f32d1c50a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] Calling method '.version_select at 0x7fb99d4e7160>' {{(pid=117929) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 03 10:09:21.796559 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO nova.api.openstack.requestlog [None req-69ae93e3-3e1f-4bdc-bc3b-122f32d1c50a tempest-TestMinimumBasicScenario-542093094 tempest-TestMinimumBasicScenario-542093094-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-160260521" status: 202 len: 0 microversion: 2.1 time: 0.024477 Aug 03 10:09:21.797164 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: [pid: 117929|app: 0|req: 1715/3308] 10.222.0.20 () {58 vars in 1269 bytes} [Wed Aug 3 10:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-160260521 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 03 10:10:43.559483 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:10:43.560046 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:12:07.349964 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:12:07.350605 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:12:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:12:15.114649 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:12:15.115268 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:12:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:12:20.631670 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:12:20.632404 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:14:03.567950 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:14:03.568550 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:14:22.765579 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:14:22.766247 dv-cinder-844563-5-iscsi devstack@n-api.service[117928]: Wed Aug 3 10:14:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 03 10:14:23.932833 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 03 10:14:23.933390 dv-cinder-844563-5-iscsi devstack@n-api.service[117929]: Wed Aug 3 10:14:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!